-- Logs begin at Wed 2022-08-17 15:19:06 UTC, end at Wed 2022-08-17 16:36:38 UTC. -- Aug 17 16:01:28.757908 dv-cinder-852208-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 16:01:28.765073 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 16:01:28.767084 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 16:01:28 2022] *** Aug 17 16:01:28.767084 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 16:01:28.767084 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 16:01:28.767084 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: nodename: dv-cinder-852208-6-iscsi Aug 17 16:01:28.767084 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: machine: x86_64 Aug 17 16:01:28.767084 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: clock source: unix Aug 17 16:01:28.767084 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: pcre jit disabled Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: detected number of CPU cores: 4 Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: current working directory: / Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: detected binary path: /usr/bin/uwsgi-core Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: your processes number limit is 47680 Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: your memory page size is 4096 bytes Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: detected max file descriptor number: 2048 Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: lock engine: pthread robust mutexes Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: thunder lock: enabled Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 16:01:28.767540 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 16:01:28.809742 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: Python main interpreter initialized at 0x5564bbe699c0 Aug 17 16:01:28.809742 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: python threads support enabled Aug 17 16:01:28.809742 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: your server socket listen backlog is limited to 100 connections Aug 17 16:01:28.809742 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: your mercy for graceful operations on workers is 90 seconds Aug 17 16:01:28.810143 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 16:01:28.810223 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: *** Operational MODE: preforking *** Aug 17 16:01:28.810460 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: *** uWSGI is running in multiple interpreter mode *** Aug 17 16:01:28.810460 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: spawned uWSGI master process (pid: 81690) Aug 17 16:01:28.810669 dv-cinder-852208-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 17 16:01:28.815832 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: spawned uWSGI worker 1 (pid: 81703, cores: 1) Aug 17 16:01:28.815832 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: spawned uWSGI worker 2 (pid: 81704, cores: 1) Aug 17 16:01:28.815832 dv-cinder-852208-6-iscsi devstack@keystone.service[81690]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 16:01:33.132806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:33.132806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: from cryptography.utils import int_from_bytes Aug 17 16:01:33.133582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:33.133582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: from cryptography.utils import int_from_bytes Aug 17 16:01:33.134056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:33.134056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: from cryptography.utils import int_from_bytes Aug 17 16:01:33.134503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:33.134503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: from cryptography.utils import int_from_bytes Aug 17 16:01:33.183155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:01:33.183330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:01:33.183526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] command line args: [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:01:33.183817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:01:33.184004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ================================================================================ {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:01:33.184261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] admin_token = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.184347 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:01:33.184490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:01:33.184575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] config_dir = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.184684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] command line args: [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:01:33.184763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.184865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] config_source = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.184949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:01:33.185046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] debug = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.185124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ================================================================================ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:01:33.185246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.185500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] admin_token = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.185626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] config_dir = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.185708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.185774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.185838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.185956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] config_source = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] debug = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] list_limit = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] log_config_append = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.186991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] log_dir = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] log_file = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] log_config_append = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.187952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] log_dir = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] log_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.188988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.189869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.190967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] publish_errors = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.191959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] publish_errors = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] standard_threads = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.192860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.193018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.193102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.193232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.193310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.193410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] use_journal = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] standard_threads = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] use_json = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] use_stderr = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] use_syslog = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.194950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.195022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.195103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] use_journal = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.195179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.195255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] use_json = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.195395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.195474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] use_stderr = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.195590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] use_syslog = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.195678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.195846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:33.195926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.196922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.197899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.198860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.199845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.200856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.201969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.202975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.203944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.204886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.205951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.206960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207422 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.207948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.208997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.209083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.209312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.209919 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.210031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.210266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.210357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.210529 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.210651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.210769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.210892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.211992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.212968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.213928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.214876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.215921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.216973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.217909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.218922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.219905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220259 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] auth.external = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.220978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] auth.password = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] auth.token = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.221934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.external = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.password = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.222976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.token = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] credential.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.223961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.224928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.225103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.225251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.225362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.225606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.225700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.225864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.225944 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.226909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.227942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.228913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.229085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.229164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.229323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.229403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.229556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.229634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.229802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.230133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.230305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.230385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.230533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.230611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.230781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.230860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.231845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.232955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.233893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234377 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.234933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.235921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.236857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.237945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.238904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.239867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.240041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.240120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.240283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.240375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.240536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.240651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.240942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.241011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.241312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.241382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.241580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.241649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.241818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.241886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.242843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.243985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.244921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.245002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.245158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.245236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.245397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.245638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.245877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.245957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.246937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.247107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.247186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.247346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.247426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.247576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.247846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.248090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.248330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.248570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.248807 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.249056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.249309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.249547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.249803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.250037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.250283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.250521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.250758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.250996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.251248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.251466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.251547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.251712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.251790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.251976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.252966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.253047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.253218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.253379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.253459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.253692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.253876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.253958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.254165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.254337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.254464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.254631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] role.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.254807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.254916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] role.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.255136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.255227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.255391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.255641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.255739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.255912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.256716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.256811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.257155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.257246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.257445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.257646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.257735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.257957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.258119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.258215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.258467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.258592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.258724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.258884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.258964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.259994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.260150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.260356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.260435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.260600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.260687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.260858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.260938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.261110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.261188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.261352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.261439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.261603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.261682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.261840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.262099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.262177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.262353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.262547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.262626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.262815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.263018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.263097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.263268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.263481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.263560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.263772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.263974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.264055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.264277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.264432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] role.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.264512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.264737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.264977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.265055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] role.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.265216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.265296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.265468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.265547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.265763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.265884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.266022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.266276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.266383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.266527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.266777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.266856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.267028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.267281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.267359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.267517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.267770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.267896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.268044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.268284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.268364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.268531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.268758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.269035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.269115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.269289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.269507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.269586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.269783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.269989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.270070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.270270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.270445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.270524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.270814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.270900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.271087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.connection = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.271276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.271365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.271585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.271726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.271959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.272218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.272351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.272448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.272522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.272689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.272770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.272932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273506 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.273997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.274950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.275102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.275182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.275336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.275415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.275573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.275651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.275731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81704) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:01:33.275877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.276078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.276329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.276569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.276815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.277061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.277310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.277546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.277785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.278021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.278270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.278523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.278755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.278999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.279294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.279559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.279821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.280608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.280849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.281089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.281325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.281561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.281797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.282033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.282275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.282511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.282753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.282987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.283234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.283469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.283711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.283977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.284217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.284453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:33.284623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:01:33.305981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.306207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.306428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.309705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.309940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.310165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.315064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.318421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.343464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.343703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.345104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.345340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.398212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.398538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.447371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.447605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.448211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.448450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.606051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.606294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.606496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.606586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.606723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.606808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.606942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.607026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.607156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.607247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.607372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.607588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.631057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.631339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.631594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.631858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.632067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.632290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.632514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.633169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.633407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.633634 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.633858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.634080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.634297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.634514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.645004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.645996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.658280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.658487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.658651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.658749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.658888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.658971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.659114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.659196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.659330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.659414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.659546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81704) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.659629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.659759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.660001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:33.676669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.676883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:33.677215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.677300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.677419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:33.677515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:33.677700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.677783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.677993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.678075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:33.678476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.678682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.678797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.678956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.679314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.679583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.688356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.688639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.688916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.688999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.689197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.689291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.689472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.689758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.696995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.697675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.699897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.700186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.700475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.700557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.700765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.700848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.701961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.702147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.702272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.702423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.702558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.702802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.702884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.703081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.703352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.726120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.726972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.727585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.727897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.728454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.728736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.732826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.733113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.733398 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.733609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.733894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.734178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.739725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.740041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.740514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.741013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.744167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.744465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.744754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.745044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.745126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.745330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.745414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.745614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.745697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.745891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.745982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.746165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.746247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.746439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.746710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.746978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.763636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.763944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.764574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.764854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.767794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.768699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.771021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.771324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.772526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.773003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.776227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.777185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.779369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.780307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.782621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.782927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.783220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.783507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.783591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.783786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.783899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.784097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.784180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.784383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.784674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.784969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.799913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.800208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.800483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.800763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.800973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.801263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.801534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.801803 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.807759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.809071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.809317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.809610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.810592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.810870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.812263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.812553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.812842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.813156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.813439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.813522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.813778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.814072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.814373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.814655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.825468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.825758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.826099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.826326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.826612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.826764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.826918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.827071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.827221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.827362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.827549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.827747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.827990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.828292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.842709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.843998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.845773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.846992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.848691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.850509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.850676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.852034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.852177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.852467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.852776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.853494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.853779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.854072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.859465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.860746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.860947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.862175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.863939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.864245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.864540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.864827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.865138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.866025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.866530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.866923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.873542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.873841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.874132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.874792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.875088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.875374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.881032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81704) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.881409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.881831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.882118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.882395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:33.882479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.882674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.882758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.882956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.883039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.883234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.883321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.883509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.883593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.883783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.883894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.884982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81704) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.885184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.885447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.885720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.885987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:33.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564bbe699c0 pid: 81704 (default app) Aug 17 16:01:33.920700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5564bbe699c0 pid: 81703 (default app) Aug 17 16:01:33.922703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ccd04-e120-4516-84a9-461713c6eb12 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:33.922992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ccd04-e120-4516-84a9-461713c6eb12 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:33.923266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ccd04-e120-4516-84a9-461713c6eb12 None None] PATH_INFO: `/v3` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:33.927465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Wed Aug 17 16:01:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:40.484127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5827e-f833-406c-85a6-03382370475e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:40.484639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5827e-f833-406c-85a6-03382370475e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:40.484721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5827e-f833-406c-85a6-03382370475e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:40.488911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:01:40.494294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:40.494693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:40.494839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:40.565081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: INFO dbcounter [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] Registered counter for database keystone Aug 17 16:01:40.585590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG oslo_db.sqlalchemy.engines [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81704) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:01:40.591659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writer thread running {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:01:40.777227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG passlib.handlers.bcrypt [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81704) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 16:01:40.777568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG passlib.handlers.bcrypt [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81704) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 16:01:40.832758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:40.834424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:40.966353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 16:01:41.396664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5827e-f833-406c-85a6-03382370475e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:41.464748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: INFO dbcounter [None req-fdc5827e-f833-406c-85a6-03382370475e None None] Registered counter for database keystone Aug 17 16:01:41.486528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG oslo_db.sqlalchemy.engines [None req-fdc5827e-f833-406c-85a6-03382370475e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:01:41.493340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writer thread running {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:01:41.611605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5827e-f833-406c-85a6-03382370475e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:41.615881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9c209-11ff-40d4-9ef3-51d9c9ab4baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:41.616501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9c209-11ff-40d4-9ef3-51d9c9ab4baf admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:41.616780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9c209-11ff-40d4-9ef3-51d9c9ab4baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:41.617052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9c209-11ff-40d4-9ef3-51d9c9ab4baf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:41.624993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9c209-11ff-40d4-9ef3-51d9c9ab4baf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:41.675905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f2b9c209-11ff-40d4-9ef3-51d9c9ab4baf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 16:01:41.676197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9c209-11ff-40d4-9ef3-51d9c9ab4baf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:41.686904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Aug 17 16:01:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 16:01:41.692841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:41.707424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7360206-7b62-46c3-929e-84a586c2ad28 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:41.712647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1661f9-f733-42e0-bde9-2100ba044d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:41.713754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1661f9-f733-42e0-bde9-2100ba044d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:41.714041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1661f9-f733-42e0-bde9-2100ba044d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:41.714313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1661f9-f733-42e0-bde9-2100ba044d66 admin admin] PATH_INFO: `/v3/projects/8e2e0137191a4168b0b70f0ebaa36507` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:41.715905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1661f9-f733-42e0-bde9-2100ba044d66 admin admin] RBAC: Authorizing `identity:get_project(project_id=8e2e0137191a4168b0b70f0ebaa36507)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:41.768549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea1661f9-f733-42e0-bde9-2100ba044d66 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 16:01:41.768899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1661f9-f733-42e0-bde9-2100ba044d66 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:41.774220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Aug 17 16:01:41 2022] GET /identity/v3/projects/8e2e0137191a4168b0b70f0ebaa36507 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:43.637895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7a7c-82c1-4918-9bda-31f097e82550 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:43.638433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7a7c-82c1-4918-9bda-31f097e82550 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:43.638433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7a7c-82c1-4918-9bda-31f097e82550 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:43.642524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:43.647824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5f64-6ca2-43ee-8fbe-cbf0d1b52001 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:43.648264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5f64-6ca2-43ee-8fbe-cbf0d1b52001 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:43.648393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5f64-6ca2-43ee-8fbe-cbf0d1b52001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:43.668601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5f9e5f64-6ca2-43ee-8fbe-cbf0d1b52001 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:43.670133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5f9e5f64-6ca2-43ee-8fbe-cbf0d1b52001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:43.678684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 16:01:43.944322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a7a7c-82c1-4918-9bda-31f097e82550 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:43.956139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a7a7c-82c1-4918-9bda-31f097e82550 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:43.960915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178f61b-9f68-4972-8cbf-215bf53d43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:43.961510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f61b-9f68-4972-8cbf-215bf53d43b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:43.961789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f61b-9f68-4972-8cbf-215bf53d43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:43.962061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178f61b-9f68-4972-8cbf-215bf53d43b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:43.969563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178f61b-9f68-4972-8cbf-215bf53d43b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:43.971338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178f61b-9f68-4972-8cbf-215bf53d43b0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:43.980342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Aug 17 16:01:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:01:43.985655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5f64-6ca2-43ee-8fbe-cbf0d1b52001 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:43.995561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5f64-6ca2-43ee-8fbe-cbf0d1b52001 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:43.999919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d2295-3919-432c-9525-3b6c64026bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:44.000548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2295-3919-432c-9525-3b6c64026bef admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:44.000831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2295-3919-432c-9525-3b6c64026bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:44.001105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d2295-3919-432c-9525-3b6c64026bef admin admin] PATH_INFO: `/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:44.002411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d2295-3919-432c-9525-3b6c64026bef admin admin] RBAC: Authorizing `identity:get_user(user_id=7d6febb46d1d4d2ea74959cb655ad9f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:44.004286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d2295-3919-432c-9525-3b6c64026bef admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:44.006473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Aug 17 16:01:43 2022] GET /identity/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:45.979759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a7dc7-6587-47c3-81c6-6e7273482023 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:45.980547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a7dc7-6587-47c3-81c6-6e7273482023 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:45.980636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a7dc7-6587-47c3-81c6-6e7273482023 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:45.981933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:45.987195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6702-266e-4bc4-851f-cb9b3e5eb2dc None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:45.987584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6702-266e-4bc4-851f-cb9b3e5eb2dc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:45.987759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6702-266e-4bc4-851f-cb9b3e5eb2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.005494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95e92-d497-4e3f-87fa-0bc6f1323c95 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.005827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95e92-d497-4e3f-87fa-0bc6f1323c95 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.006105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95e92-d497-4e3f-87fa-0bc6f1323c95 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.006383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-810f6702-266e-4bc4-851f-cb9b3e5eb2dc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:46.007549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:01:46.007645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-810f6702-266e-4bc4-851f-cb9b3e5eb2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:46.012500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.012786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.013063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.055673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG passlib.handlers.bcrypt [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81703) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 16:01:46.056108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG passlib.handlers.bcrypt [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81703) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 16:01:46.092436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:01:46.103857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:46.105729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:46.202021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:01:46.363036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6702-266e-4bc4-851f-cb9b3e5eb2dc None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:46.386407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:46.467002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6702-266e-4bc4-851f-cb9b3e5eb2dc None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:46.472497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:46.500340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:46.500977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.501259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.501535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.516072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:01:46.525429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:01:46.526415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:01:46.527242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:01:46.532477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:46.576957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66836ff-cb64-42ea-a039-bd716dfe4b9f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:46.579213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:46.614088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:46.616322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:46.617235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.617530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.617809 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.635179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5df25-76cd-45dd-98ed-b396fd0c6eeb None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:46.668904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:46.669514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.669797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.670070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.670735 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:01:46.671041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:46.672478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:46.684245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:46.685051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:46.686550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:46.689591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:46.785633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:01:46.790029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51caa8-cc98-4e08-acfa-1ba7ddfe5945 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:46.792095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:46.796051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:46.828544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:46.829187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.829470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.829742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] PATH_INFO: `/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.830985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] RBAC: Authorizing `identity:get_user(user_id=7d6febb46d1d4d2ea74959cb655ad9f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:46.832512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:46.837486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:46.840453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:46.856787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:46.902423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28ac14-38bc-4d4b-abb1-baf862effafa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:46.938672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:46.939526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.939836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.940115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.942710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246d33a-069e-4edd-b6c6-b8c940ae6bff None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:46.960786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:46.962248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:46.978267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:46.978916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:46.979202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:46.979483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:46.980905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:01:46.981001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:01:46.982193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:01:46.982985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:01:46.982985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:01:46.982985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:01:46.982985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:01:46.983219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:46.984043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:46.988210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:46.989642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:47.051328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:47.080578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:47.100533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33083f9a-7bf2-452d-9c6b-9012a607f3d7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:47.102278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d629e4-aeeb-4c89-976f-4bf6cad38d61 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:47.133877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a8035-824b-4ab0-a68a-929dd951b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:47.134485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8035-824b-4ab0-a68a-929dd951b26f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:47.134767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8035-824b-4ab0-a68a-929dd951b26f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:47.135040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8035-824b-4ab0-a68a-929dd951b26f None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:47.135680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a8035-824b-4ab0-a68a-929dd951b26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:01:47.136011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a8035-824b-4ab0-a68a-929dd951b26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:47.136101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e55d56-2013-4c33-9629-0b3eabd7124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:47.136630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55d56-2013-4c33-9629-0b3eabd7124a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:47.136917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55d56-2013-4c33-9629-0b3eabd7124a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:47.137196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55d56-2013-4c33-9629-0b3eabd7124a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:47.137392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a8035-824b-4ab0-a68a-929dd951b26f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:47.137921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e55d56-2013-4c33-9629-0b3eabd7124a None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.domain.id=default, user.id=7d6febb46d1d4d2ea74959cb655ad9f0) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:01:47.138243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e55d56-2013-4c33-9629-0b3eabd7124a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:47.139692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e55d56-2013-4c33-9629-0b3eabd7124a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:47.146758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/role_assignments?user.id=7d6febb46d1d4d2ea74959cb655ad9f0&scope.domain.id=default&role.id=b73be4c438e74c73b714b299c1412271 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:47.157573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:49.171723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364c1c-df11-4c1e-8243-5fa021b6c45f None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:49.172775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364c1c-df11-4c1e-8243-5fa021b6c45f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:49.173275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364c1c-df11-4c1e-8243-5fa021b6c45f None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:49.174800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:49.208513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4113a-74f4-428b-85ad-acdb61cd754a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:49.210169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4113a-74f4-428b-85ad-acdb61cd754a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:49.210640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4113a-74f4-428b-85ad-acdb61cd754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:49.240769 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2ff4113a-74f4-428b-85ad-acdb61cd754a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:49.242309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2ff4113a-74f4-428b-85ad-acdb61cd754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:49.321135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:01:49.386107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79ce4-1ccb-4bc7-818d-2339f60ec760 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:49.386736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79ce4-1ccb-4bc7-818d-2339f60ec760 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:49.387222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79ce4-1ccb-4bc7-818d-2339f60ec760 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:49.388790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:49.394171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac414-7663-4a17-ad46-924a697c3eef None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:49.394703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac414-7663-4a17-ad46-924a697c3eef None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:49.395188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ac414-7663-4a17-ad46-924a697c3eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:49.436062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-168ac414-7663-4a17-ad46-924a697c3eef None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:49.437596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-168ac414-7663-4a17-ad46-924a697c3eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:49.493511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:49.530255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 12/25] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:01:49.816895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79ce4-1ccb-4bc7-818d-2339f60ec760 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:49.954895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79ce4-1ccb-4bc7-818d-2339f60ec760 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:49.977469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca328ad-7dda-4eb4-939a-94a8e28defb6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:49.977760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca328ad-7dda-4eb4-939a-94a8e28defb6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:49.978026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca328ad-7dda-4eb4-939a-94a8e28defb6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:49.979373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 13/26] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:49.987935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a7fe-90d3-4070-bdff-0de5620bcf13 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:49.988213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a7fe-90d3-4070-bdff-0de5620bcf13 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:49.988497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a7fe-90d3-4070-bdff-0de5620bcf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.024462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a4e0a7fe-90d3-4070-bdff-0de5620bcf13 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:50.025680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a4e0a7fe-90d3-4070-bdff-0de5620bcf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:50.041322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:50.041975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.042255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.042525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.069967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:01:50.079547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:01:50.080410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:01:50.081162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:01:50.083901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 14/27] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:01:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:01:50.089830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:50.095647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:50.185813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 14/28] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:01:50.187053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbc513-e3fe-4ab4-9925-7a087b376f70 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.187337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbc513-e3fe-4ab4-9925-7a087b376f70 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.187613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbc513-e3fe-4ab4-9925-7a087b376f70 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.188874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 15/29] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:50.189659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbc513-e3fe-4ab4-9925-7a087b376f70 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:50.237980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4570af-7ed1-48f3-81ff-68cf90134e2f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:50.276541 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace24fd7-ce35-4083-b34b-8dbe518cf517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:50.277164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24fd7-ce35-4083-b34b-8dbe518cf517 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.277445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24fd7-ce35-4083-b34b-8dbe518cf517 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.277718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace24fd7-ce35-4083-b34b-8dbe518cf517 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.278386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24fd7-ce35-4083-b34b-8dbe518cf517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:01:50.278691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24fd7-ce35-4083-b34b-8dbe518cf517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:50.280112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace24fd7-ce35-4083-b34b-8dbe518cf517 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:50.295220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 15/30] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:50.299431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6e25-6b56-4ea0-9742-efa88ad7a8e0 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.300794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6e25-6b56-4ea0-9742-efa88ad7a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.301072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d6e25-6b56-4ea0-9742-efa88ad7a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.336117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6a2d6e25-6b56-4ea0-9742-efa88ad7a8e0 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:50.341590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6a2d6e25-6b56-4ea0-9742-efa88ad7a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:50.400410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbc513-e3fe-4ab4-9925-7a087b376f70 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:50.416301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:50.454947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:50.455478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:50.456717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.457137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.457617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.468938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 16/31] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:01:50.470136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6e25-6b56-4ea0-9742-efa88ad7a8e0 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:50.470930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:50.472483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:01:50.504241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:01:50.505244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:01:50.507188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:01:50.507188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:01:50.507188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:01:50.509546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 16/32] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:01:50.510527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:50.619297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d6e25-6b56-4ea0-9742-efa88ad7a8e0 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:50.656063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:50.656709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.656982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.657258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] PATH_INFO: `/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.658411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6febb46d1d4d2ea74959cb655ad9f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:50.663831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:50.663831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 17/33] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:01:50 2022] GET /identity/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:50.663831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:50.701452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bb1e2-76d5-4d7d-bd97-cb3d6c38a51a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:50.730008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:50.759968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:50.760592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.760874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.761151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.761823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:50.763204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:50.775355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7874e9d-f2f4-40a5-8257-bbe3cec3acb7 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:50.814010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:50.814631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:50.814958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:50.815224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:50.815907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:01:50.816213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:50.817666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:50.838377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 18/34] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:50.839009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:50.902671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 17/35] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 17 16:01:50 2022] POST /identity/v3/roles => generated 219 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:01:50.904048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:50.927285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:50.960177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba348a6-a470-4e28-b8c2-7d88c17094d8 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:51.007987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:51.023859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a636e-4848-4b03-96a4-2f452b4436ed None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:51.028743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:51.029741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.030242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.030709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.032962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:51.034784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:51.037259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 19/36] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:51.038636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:51.070453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:51.071100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.071387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.071666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.072401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:51.073986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:51.090260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 17 16:01:50 2022] POST /identity/v3/roles => generated 225 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:01:51.090260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:51.185631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19026259-e8ca-4004-9477-cad622ab8e07 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:51.211782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:51.243707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1c1af-6974-4821-bba5-763f57f9f30e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:51.250765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182612f-c8b3-4869-9a4c-2904ae09a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:51.251392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182612f-c8b3-4869-9a4c-2904ae09a84c None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.251674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182612f-c8b3-4869-9a4c-2904ae09a84c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.252303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182612f-c8b3-4869-9a4c-2904ae09a84c None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.252688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182612f-c8b3-4869-9a4c-2904ae09a84c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:51.254743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182612f-c8b3-4869-9a4c-2904ae09a84c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:51.284373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624df341-549b-413c-9046-ca72628a0402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:51.285285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df341-549b-413c-9046-ca72628a0402 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.285744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df341-549b-413c-9046-ca72628a0402 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.286036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624df341-549b-413c-9046-ca72628a0402 None admin] PATH_INFO: `/v3/domains/default/users/7d6febb46d1d4d2ea74959cb655ad9f0/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.288758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624df341-549b-413c-9046-ca72628a0402 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7d6febb46d1d4d2ea74959cb655ad9f0, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:51.290206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624df341-549b-413c-9046-ca72628a0402 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:51.308644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 19/38] 10.222.0.60 () {58 vars in 1361 bytes} [Wed Aug 17 16:01:51 2022] PUT /identity/v3/domains/default/users/7d6febb46d1d4d2ea74959cb655ad9f0/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:01:51.309993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877df621-f8a0-4f3c-b7aa-396b749131d5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.310288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877df621-f8a0-4f3c-b7aa-396b749131d5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.310571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877df621-f8a0-4f3c-b7aa-396b749131d5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.311952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 20/39] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:51.312906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a883b-fd8c-49f1-8227-d3ca21736a71 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.313205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a883b-fd8c-49f1-8227-d3ca21736a71 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.313476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a883b-fd8c-49f1-8227-d3ca21736a71 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.314752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 21/40] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:51.319781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcdc6c-2a1a-4159-8dd6-ec12088de1bd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.320265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcdc6c-2a1a-4159-8dd6-ec12088de1bd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.320559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcdc6c-2a1a-4159-8dd6-ec12088de1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.340513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-02bcdc6c-2a1a-4159-8dd6-ec12088de1bd None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:51.342099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-02bcdc6c-2a1a-4159-8dd6-ec12088de1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:51.407829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:01:51 2022] POST /identity/v3/projects => generated 301 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:01:51.407829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84f5d-3ad8-4507-bf95-30b948e1824a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.407829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84f5d-3ad8-4507-bf95-30b948e1824a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.407829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b84f5d-3ad8-4507-bf95-30b948e1824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.429767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 22/42] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:01:51.430288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-54b84f5d-3ad8-4507-bf95-30b948e1824a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:51.431990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-54b84f5d-3ad8-4507-bf95-30b948e1824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:51.486208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:51.518547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 21/43] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:01:51.708555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcdc6c-2a1a-4159-8dd6-ec12088de1bd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:51.777757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:51.790297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84f5d-3ad8-4507-bf95-30b948e1824a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:51.816739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcdc6c-2a1a-4159-8dd6-ec12088de1bd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:51.856428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:51.857087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.857375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.857659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.858783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:51.860288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:51.861863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 23/44] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:51.867987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:51.913564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b84f5d-3ad8-4507-bf95-30b948e1824a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:51.950231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7fee5-d839-4225-b283-9adabbd3d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:51.950860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7fee5-d839-4225-b283-9adabbd3d9dc None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:51.951152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7fee5-d839-4225-b283-9adabbd3d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:51.951430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7fee5-d839-4225-b283-9adabbd3d9dc None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:51.952154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7fee5-d839-4225-b283-9adabbd3d9dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:51.953683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7fee5-d839-4225-b283-9adabbd3d9dc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:51.970985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 17 16:01:51 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:01:51.977269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7776e38-1e2c-4b7e-95fe-f65198d92118 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:52.018722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89324900-f6c9-45e7-ace3-863143ea4fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:52.019370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324900-f6c9-45e7-ace3-863143ea4fe6 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:52.019654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324900-f6c9-45e7-ace3-863143ea4fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:52.019968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89324900-f6c9-45e7-ace3-863143ea4fe6 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:52.020659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89324900-f6c9-45e7-ace3-863143ea4fe6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:52.022404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89324900-f6c9-45e7-ace3-863143ea4fe6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:52.029683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:52.055998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:01:51 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:01:53.258317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65553-7c31-40f8-8a87-47e792f5e706 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:53.258832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65553-7c31-40f8-8a87-47e792f5e706 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:53.258913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65553-7c31-40f8-8a87-47e792f5e706 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:53.260278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 23/47] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:53.265587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4791d-c6db-45dc-89b0-0a1cc826fdb9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:53.265977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4791d-c6db-45dc-89b0-0a1cc826fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:53.266284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4791d-c6db-45dc-89b0-0a1cc826fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:53.284474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b2c4791d-c6db-45dc-89b0-0a1cc826fdb9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:53.285669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b2c4791d-c6db-45dc-89b0-0a1cc826fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:53.351862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 25/48] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:01:53.620198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65553-7c31-40f8-8a87-47e792f5e706 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:53.765876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:53.833163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65553-7c31-40f8-8a87-47e792f5e706 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:53.868309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ff8f3-34cc-4951-a250-502dfc5c83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:53.868964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ff8f3-34cc-4951-a250-502dfc5c83a0 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:53.869252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ff8f3-34cc-4951-a250-502dfc5c83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:53.869533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ff8f3-34cc-4951-a250-502dfc5c83a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:53.879786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ff8f3-34cc-4951-a250-502dfc5c83a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-352ff8f3-34cc-4951-a250-502dfc5c83a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:01:53.884734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:01:53.885553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:01:53.886413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 24/49] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:01:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:01:53.891636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4791d-c6db-45dc-89b0-0a1cc826fdb9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:53.955624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a22b5-fd8e-4fda-8207-cd5282d9b3ea None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:53.955946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a22b5-fd8e-4fda-8207-cd5282d9b3ea None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:53.956229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a22b5-fd8e-4fda-8207-cd5282d9b3ea None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:53.957571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 25/50] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:01:53.963081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10f10-4778-4624-aa90-09fc5304aa44 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:53.963370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10f10-4778-4624-aa90-09fc5304aa44 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:53.963651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10f10-4778-4624-aa90-09fc5304aa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:53.981470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-71b10f10-4778-4624-aa90-09fc5304aa44 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:53.982678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-71b10f10-4778-4624-aa90-09fc5304aa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:53.994786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4791d-c6db-45dc-89b0-0a1cc826fdb9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:54.012623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:54.031524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:54.032173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:54.032463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:54.032744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:54.033418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:01:54.033734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:54.035121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:54.047900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 26/51] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:54.051315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 26/52] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:01:54.053969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:54.150584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d0100-00c4-4e53-8c41-a9b76c1d3c47 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:54.184970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:54.185599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:54.185884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:54.186165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] PATH_INFO: `/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:54.187296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6febb46d1d4d2ea74959cb655ad9f0)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:54.188766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:54.190323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 27/53] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:01:54 2022] GET /identity/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:54.196062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10f10-4778-4624-aa90-09fc5304aa44 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:54.220243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:54.297921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10f10-4778-4624-aa90-09fc5304aa44 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:54.318286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:54.332689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:54.333854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:54.334202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:54.334646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:54.335762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:54.337259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:54.338975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 27/54] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:54.344393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:54.438872 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:54.448502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b70589-9851-4c43-bdc8-0dad1984fb0a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:54.477084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:54.485166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:54.485788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:54.486075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:54.486353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:54.487088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.domain.id=default, user.id=7d6febb46d1d4d2ea74959cb655ad9f0) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:01:54.487399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:54.488922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:54.494717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Aug 17 16:01:54 2022] GET /identity/v3/role_assignments?user.id=7d6febb46d1d4d2ea74959cb655ad9f0&scope.domain.id=default&role.id=b73be4c438e74c73b714b299c1412271 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:54.532151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70adda5-92f6-49de-b750-da9eaabd8509 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:54.567885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5636-47b8-4297-9f82-b4e7029d49dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:54.568648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5636-47b8-4297-9f82-b4e7029d49dd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:54.568935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5636-47b8-4297-9f82-b4e7029d49dd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:54.569234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5636-47b8-4297-9f82-b4e7029d49dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:54.570442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5636-47b8-4297-9f82-b4e7029d49dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:54.571947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5636-47b8-4297-9f82-b4e7029d49dd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:54.573572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 28/56] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:01:54.579276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:54.683621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b6614-3acb-4464-9f74-575dbb52e241 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:54.718180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02510c50-1aa9-406a-85ea-55630113e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:54.718737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02510c50-1aa9-406a-85ea-55630113e33a None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:54.719023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02510c50-1aa9-406a-85ea-55630113e33a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:54.719299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02510c50-1aa9-406a-85ea-55630113e33a None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:54.720004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02510c50-1aa9-406a-85ea-55630113e33a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:54.721467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02510c50-1aa9-406a-85ea-55630113e33a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:54.747430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 29/57] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Aug 17 16:01:54 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:01:56.637377 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2c50-547f-4593-af11-f398f8571124 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:56.637916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2c50-547f-4593-af11-f398f8571124 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:56.637916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2c50-547f-4593-af11-f398f8571124 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:56.639273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 29/58] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:01:56.644257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9156c-fa73-4ff8-94b9-d28fc020caee None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:56.644654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9156c-fa73-4ff8-94b9-d28fc020caee None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:56.644818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9156c-fa73-4ff8-94b9-d28fc020caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:56.663069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a3f9156c-fa73-4ff8-94b9-d28fc020caee None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:01:56.664928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a3f9156c-fa73-4ff8-94b9-d28fc020caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:01:56.666864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:56.731386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 30/59] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:01:56.998915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2c50-547f-4593-af11-f398f8571124 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:57.106098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2c50-547f-4593-af11-f398f8571124 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:57.121622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:57.139368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cceb0a-2088-4003-887a-2061728b585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:57.140027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cceb0a-2088-4003-887a-2061728b585e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:57.140312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cceb0a-2088-4003-887a-2061728b585e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:57.140589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cceb0a-2088-4003-887a-2061728b585e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:57.141689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cceb0a-2088-4003-887a-2061728b585e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:57.143128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cceb0a-2088-4003-887a-2061728b585e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:57.144708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 30/60] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:01:57.150824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9156c-fa73-4ff8-94b9-d28fc020caee None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:01:57.246047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9156c-fa73-4ff8-94b9-d28fc020caee None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:01:57.278632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040fb9b-92aa-4345-b961-811931f52d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:01:57.279174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040fb9b-92aa-4345-b961-811931f52d8a None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:57.279455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040fb9b-92aa-4345-b961-811931f52d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:57.279729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040fb9b-92aa-4345-b961-811931f52d8a None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:57.280399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040fb9b-92aa-4345-b961-811931f52d8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:01:57.281838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040fb9b-92aa-4345-b961-811931f52d8a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:01:57.295464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:01:57.307548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 31/61] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:01:57 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:00.242616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5718-ec22-49d7-b343-e11002b32aba None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.243679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5718-ec22-49d7-b343-e11002b32aba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.244205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c5718-ec22-49d7-b343-e11002b32aba None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.245983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 31/62] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:00.251433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7636df-bcdc-4073-af53-49786e842687 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.252281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7636df-bcdc-4073-af53-49786e842687 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.252757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7636df-bcdc-4073-af53-49786e842687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.276457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6a7636df-bcdc-4073-af53-49786e842687 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:00.277969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6a7636df-bcdc-4073-af53-49786e842687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:00.324486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888bda-8cb7-4be6-af94-b7c99f9f6480 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.325130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888bda-8cb7-4be6-af94-b7c99f9f6480 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.325642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888bda-8cb7-4be6-af94-b7c99f9f6480 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.327167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 32/63] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:00.333221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b42f-a810-43e2-b12a-f5dd60c87a6f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.333752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b42f-a810-43e2-b12a-f5dd60c87a6f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.334238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41b42f-a810-43e2-b12a-f5dd60c87a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.366631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6c41b42f-a810-43e2-b12a-f5dd60c87a6f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:00.367846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6c41b42f-a810-43e2-b12a-f5dd60c87a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:00.399376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 32/64] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:00.472479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 33/65] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:00.485414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7465-03ea-48fd-92fa-e778abf39ee8 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.485708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7465-03ea-48fd-92fa-e778abf39ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.485992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7465-03ea-48fd-92fa-e778abf39ee8 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.487328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 33/66] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:00.492554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a7a4-141d-4613-90a9-6de920d61919 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.492912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a7a4-141d-4613-90a9-6de920d61919 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.493137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06a7a4-141d-4613-90a9-6de920d61919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.516815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4a06a7a4-141d-4613-90a9-6de920d61919 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:00.518034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4a06a7a4-141d-4613-90a9-6de920d61919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:00.610170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 34/67] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:00.732111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7465-03ea-48fd-92fa-e778abf39ee8 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:00.799579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5cfd-bc0b-473f-a2a6-32cb17f19067 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.799922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5cfd-bc0b-473f-a2a6-32cb17f19067 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.800089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5cfd-bc0b-473f-a2a6-32cb17f19067 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.801457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 35/68] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:00.810411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b49d51-c464-44b1-a59c-4aa63c425d96 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.810978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b49d51-c464-44b1-a59c-4aa63c425d96 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.811444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b49d51-c464-44b1-a59c-4aa63c425d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.848804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c4b49d51-c464-44b1-a59c-4aa63c425d96 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:00.850253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c4b49d51-c464-44b1-a59c-4aa63c425d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:00.883124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7465-03ea-48fd-92fa-e778abf39ee8 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:00.911434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:00.923760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:00.924434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:00.924720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:00.924991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:00.937883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:00.943058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:00.944085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:00.945024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:00.947064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:00.953433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:00.961820 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:00.993807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 36/70] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:00.994977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b49d51-c464-44b1-a59c-4aa63c425d96 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.067014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85c861-5b13-4353-85c7-9a1f6fc55bc8 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.106222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.107338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.108201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.108650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.110977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b49d51-c464-44b1-a59c-4aa63c425d96 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.122051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:01.128624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:01.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:01.135504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.157793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.159315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.159850 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.160568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.161643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:01.162509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:01.165615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:01.177151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:01.178187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.186901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:01.220742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:01.247258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc517b-0f60-4b09-a3e8-0bad68568818 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.284532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a085c-664c-432d-9ad4-a83169941bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.285308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a085c-664c-432d-9ad4-a83169941bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.285813 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a085c-664c-432d-9ad4-a83169941bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.286094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a085c-664c-432d-9ad4-a83169941bb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.291437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3996e0-e6da-4d4d-a506-0ed6a808a0e4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.296581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a085c-664c-432d-9ad4-a83169941bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-c01a085c-664c-432d-9ad4-a83169941bb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:01.301750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:01.302705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:01.303493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:01.304799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98bc0f-36b2-473d-9b23-fec9282754ce None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.305142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98bc0f-36b2-473d-9b23-fec9282754ce None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.305425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98bc0f-36b2-473d-9b23-fec9282754ce None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.306685 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 37/74] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:01.307364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98bc0f-36b2-473d-9b23-fec9282754ce None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.328461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.328997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.329283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.329558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.330221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:01.330529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:01.331914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:01.339869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 38/75] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:01.340656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.416245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98bc0f-36b2-473d-9b23-fec9282754ce None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.418591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:01.447636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:01.451194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c4508-3d71-44c3-b213-417fe041055c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.453386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.454036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.454322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.454600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] PATH_INFO: `/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.455754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] RBAC: Authorizing `identity:get_user(user_id=7d6febb46d1d4d2ea74959cb655ad9f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:01.457266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:01.458845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:01.459661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.489398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0d6e5-47c3-43b4-bf44-b3b09f721596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.490043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0d6e5-47c3-43b4-bf44-b3b09f721596 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.490330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0d6e5-47c3-43b4-bf44-b3b09f721596 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.490615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0d6e5-47c3-43b4-bf44-b3b09f721596 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.503224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0d6e5-47c3-43b4-bf44-b3b09f721596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d0d0d6e5-47c3-43b4-bf44-b3b09f721596 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:01.509336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:01.510217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:01.511002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 39/77] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:01.511630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74a20-236f-4e05-8faa-4ad06440f526 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.512635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74a20-236f-4e05-8faa-4ad06440f526 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.512635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74a20-236f-4e05-8faa-4ad06440f526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.529177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-74d74a20-236f-4e05-8faa-4ad06440f526 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:01.530373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-74d74a20-236f-4e05-8faa-4ad06440f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:01.559028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33abf43-834b-497b-990a-c1b4dca0ac8d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.591722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.592305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.592590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.592871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.593542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:01.593901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:01.595329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 40/78] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:01.595430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:01.595953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d74a20-236f-4e05-8faa-4ad06440f526 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.611041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 39/79] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:01.612601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.650741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:01.696730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:01.710806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d74a20-236f-4e05-8faa-4ad06440f526 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.732010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7645-8730-48f8-a895-138f9584c1b9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.755957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.756629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.756957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.757500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.766401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.767017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.767304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.767588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.774555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:01.776244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:01.778149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 41/80] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:01.779205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.848534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:01.850049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:01.884363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:01.892361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b1c17-bbf6-4002-b30d-6041e1997e30 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:01.926470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:01.927080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.927364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.927642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.928341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:01.928687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:01.930175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:01.939637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 42/81] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:01.941542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.951288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 40/82] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:01.952174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:01.952731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.045185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de250c-207c-4fb0-ad95-ea1a3f499cc4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.051138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ae663-6fd3-43f7-9a50-144c0d577421 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.078409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.079039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.079318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.079593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.080761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.082204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.083943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 43/83] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:02.084045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.084489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.084607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.084809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.085592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.088282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.154605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.156148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.164568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.187356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf272e3-532e-4fd2-ae75-ef61df24e19a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.221765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.222394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.222674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.222949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.224079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.225533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.227378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 44/84] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:02.228159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.256440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 41/85] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:02.258117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.297846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.334198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337734ea-9a68-490a-8fe2-468adab83592 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.365646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8d1f7-a422-43a7-9e52-abd4c497e0a2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.371391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.372073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.372359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.372637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.373788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.375235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.376856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 45/86] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:02.377619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.392901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.401236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.401879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.402160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.402433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.403546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.405090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.406659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 42/87] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:02.407400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.482014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba8722-043c-4cb6-8935-78a290733f05 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.517493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.518103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.518387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.518665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.519504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6f667-b80e-4551-a25b-5943fbf66260 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.521172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.554233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.554871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.555161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.555440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.556112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.557594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.579122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 43/88] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:02 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:02.579762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.587833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.589385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.606483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.704482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 46/89] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:02.705336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.716511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7b010-93d6-4328-9198-1f843fc08892 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.764877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.766045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.766045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.766201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.767260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.768850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.770522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 44/90] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:02.773273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.822112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.866929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31342200-7558-47ac-9cfb-329b0e9abfad None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.891615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:02.931755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.932575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.932865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.933198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.941325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7198db-be9d-460e-96ed-8ef6c22f63ca None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.996916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.997410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.997697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.997978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.998830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=7d6febb46d1d4d2ea74959cb655ad9f0) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:02.999152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:03.001281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:03.012025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 45/91] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/role_assignments?user.id=7d6febb46d1d4d2ea74959cb655ad9f0&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:03.013038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:03.029010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:03.030659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:03.261452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 47/92] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:03.270824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:03.279529 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:03.293916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:03.306826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50bec2-97aa-4150-80e7-321fe16273fc None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:03.385953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:03.388479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:03.388772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:03.389051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:03.390250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:03.391724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:03.393559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 46/93] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:03 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:03.394148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:03.485917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d06ae-5ba2-4a42-9d18-d26260b4269c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:03.549859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:03.550396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:03.550676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:03.550951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:03.551685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=1c3268fd2eb846f4bc4b8245f9be0583) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:03.552018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:03.553459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:03.562643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aee57f-7a01-4747-aaa8-4215d963ac3f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:03.576947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 48/94] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:03 2022] GET /identity/v3/role_assignments?user.id=1c3268fd2eb846f4bc4b8245f9be0583&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:03.579768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:03.634168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:03.635432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:03.635720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:03.636033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] PATH_INFO: `/v3/projects/7f083105e30d440698fd9bc16b2dc2d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:03.638865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=7f083105e30d440698fd9bc16b2dc2d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:03.640362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:03.647563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 47/95] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:03 2022] GET /identity/v3/projects/7f083105e30d440698fd9bc16b2dc2d5 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:03.653572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:03.706619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:03.752239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:03.808751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf53f1-e3fe-4a6b-bc49-f77541fd5f7f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:03.883627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eec2d-9809-455f-84f3-5788adc8c4f6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:03.922695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755127bf-8ef0-4b75-abf4-e49086f9c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:03.923321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755127bf-8ef0-4b75-abf4-e49086f9c206 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:03.923604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755127bf-8ef0-4b75-abf4-e49086f9c206 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:03.923987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755127bf-8ef0-4b75-abf4-e49086f9c206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:03.924827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755127bf-8ef0-4b75-abf4-e49086f9c206 None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=7f083105e30d440698fd9bc16b2dc2d5, user.id=1c3268fd2eb846f4bc4b8245f9be0583) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:03.925146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755127bf-8ef0-4b75-abf4-e49086f9c206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:03.926698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755127bf-8ef0-4b75-abf4-e49086f9c206 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:03.927529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88379059-60d3-4ee0-8493-e748636de034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:03.928459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379059-60d3-4ee0-8493-e748636de034 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:03.929519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379059-60d3-4ee0-8493-e748636de034 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:03.929991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88379059-60d3-4ee0-8493-e748636de034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:03.930928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379059-60d3-4ee0-8493-e748636de034 None admin] RBAC: Adding query filter params (role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=1c3268fd2eb846f4bc4b8245f9be0583) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:03.931435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379059-60d3-4ee0-8493-e748636de034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:03.933111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:03 2022] GET /identity/v3/role_assignments?user.id=1c3268fd2eb846f4bc4b8245f9be0583&scope.project.id=7f083105e30d440698fd9bc16b2dc2d5&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:03.933222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88379059-60d3-4ee0-8493-e748636de034 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:03.950033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:03 2022] GET /identity/v3/role_assignments?user.id=1c3268fd2eb846f4bc4b8245f9be0583&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:05.249419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea871-ba1c-47c1-8b2f-983405a267d7 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.249928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea871-ba1c-47c1-8b2f-983405a267d7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.250192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ea871-ba1c-47c1-8b2f-983405a267d7 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.251438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:05.256887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be67a-e259-4e99-9aea-47c0043fbec9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.257877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be67a-e259-4e99-9aea-47c0043fbec9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.258355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be67a-e259-4e99-9aea-47c0043fbec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.279863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a02be67a-e259-4e99-9aea-47c0043fbec9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:05.281372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a02be67a-e259-4e99-9aea-47c0043fbec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:05.328117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba795d-dc3e-475d-be82-8f9b1927c6de None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.328415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba795d-dc3e-475d-be82-8f9b1927c6de None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.328670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba795d-dc3e-475d-be82-8f9b1927c6de None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.330082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 50/99] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:05.336697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28cfb8-fcaa-4cce-8650-3ebb321dd202 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.336993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28cfb8-fcaa-4cce-8650-3ebb321dd202 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.337264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28cfb8-fcaa-4cce-8650-3ebb321dd202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.367787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ee28cfb8-fcaa-4cce-8650-3ebb321dd202 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:05.369660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ee28cfb8-fcaa-4cce-8650-3ebb321dd202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:05.385119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 50/100] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:05.415500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06e829-766e-4517-b917-1f5994af042f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.416158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06e829-766e-4517-b917-1f5994af042f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.416637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06e829-766e-4517-b917-1f5994af042f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.418405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 51/101] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:05.423480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118cf88-682d-451c-83e5-f48b653e9c79 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.424008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118cf88-682d-451c-83e5-f48b653e9c79 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.424499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118cf88-682d-451c-83e5-f48b653e9c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.460679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e118cf88-682d-451c-83e5-f48b653e9c79 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:05.461888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e118cf88-682d-451c-83e5-f48b653e9c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:05.499150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 51/102] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:05.589460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:05.594825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 52/103] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:05.831273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28cfb8-fcaa-4cce-8650-3ebb321dd202 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:05.859445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:05.955658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28cfb8-fcaa-4cce-8650-3ebb321dd202 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:05.995890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:05.996542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.996828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.997105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.998271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:05.999722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:06.001444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 52/104] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:06.007610 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118cf88-682d-451c-83e5-f48b653e9c79 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.056717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.189056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9fa70-f464-4883-a19b-1c983f132d55 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:06.192252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:06.226049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:06.227060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.227352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.227627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.238175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:06.239542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118cf88-682d-451c-83e5-f48b653e9c79 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:06.244058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:06.244875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:06.245618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 53/105] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:06.246225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.309862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:06.310491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.310767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.311043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.311697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:06.313185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:06.352863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd44675-58ae-4144-884d-1899d6a0b038 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:06.370467 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 53/106] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:02:06 2022] POST /identity/v3/projects => generated 302 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:06.371384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.392187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:06.393009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.393264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.393545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.406262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:06.411668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:06.412555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:06.413335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 54/107] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:06.422436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.442239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:06.488289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:06.597607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a840f5-31de-48cf-be01-c19e1f7a693d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:06.630176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d12fe4-28f5-45ff-9418-80da78daf8e5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:06.649306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:06.650277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.650753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.651770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.652716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:06.653215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:06.654810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:06.664414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 54/108] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:06.669949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.671694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:06.672454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.672835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.673210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.674717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:06.674717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:06.676548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:06.686948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 55/109] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:06.693070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.768879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:06.795220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203f73-67ab-4daf-a3e5-0bf2898723f7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:06.803311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a3572-dd0c-4fa8-99a5-a118486d52a4 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:06.810650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:06.845825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294847b-3bdc-41cd-99e8-ac3b169db895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:06.846748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294847b-3bdc-41cd-99e8-ac3b169db895 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.847034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294847b-3bdc-41cd-99e8-ac3b169db895 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.847309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294847b-3bdc-41cd-99e8-ac3b169db895 None admin] PATH_INFO: `/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.848640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294847b-3bdc-41cd-99e8-ac3b169db895 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6febb46d1d4d2ea74959cb655ad9f0)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:06.851271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294847b-3bdc-41cd-99e8-ac3b169db895 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:06.853446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 55/110] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:06 2022] GET /identity/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:06.854602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5c168-81ed-462c-a74a-f07eb4eae948 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.855138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5c168-81ed-462c-a74a-f07eb4eae948 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.855410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5c168-81ed-462c-a74a-f07eb4eae948 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.855974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:06.856756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 56/111] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:06.857139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.857567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.857773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46dfb-c41a-41fc-926b-f2018bff6fbf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.858064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46dfb-c41a-41fc-926b-f2018bff6fbf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.858339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46dfb-c41a-41fc-926b-f2018bff6fbf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.858480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] PATH_INFO: `/v3/users/06250c854f60404191d5de14593a1ea5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.859512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 57/112] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:06.865122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647667c-d448-46f3-b4f9-8db2234675b6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.865409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647667c-d448-46f3-b4f9-8db2234675b6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.865689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647667c-d448-46f3-b4f9-8db2234675b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:06.881115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] RBAC: Authorizing `identity:get_user(user_id=06250c854f60404191d5de14593a1ea5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:06.883461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:06.885265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5647667c-d448-46f3-b4f9-8db2234675b6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:06.885710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 56/113] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:06 2022] GET /identity/v3/users/06250c854f60404191d5de14593a1ea5 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:06.886485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5647667c-d448-46f3-b4f9-8db2234675b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:06.886877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:06.965779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 58/114] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:06.966979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c4a0-b356-416e-a511-8db7518fad1e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:06.967268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c4a0-b356-416e-a511-8db7518fad1e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:06.976084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5c4a0-b356-416e-a511-8db7518fad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.008209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fed5c4a0-b356-416e-a511-8db7518fad1e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:07.009409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fed5c4a0-b356-416e-a511-8db7518fad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:07.020149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ca88b-6a1f-4637-8f8e-d3cf4caca213 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:07.056626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:07.068008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:07.068940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.070007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.070531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.072599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:07.074558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:07.077181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 57/115] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:06 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:07.078436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.106724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 59/116] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:07.106724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63084e-e827-4400-9ef8-454e2650d621 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.106724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63084e-e827-4400-9ef8-454e2650d621 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.106724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63084e-e827-4400-9ef8-454e2650d621 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.106724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 60/117] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:07.106724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63084e-e827-4400-9ef8-454e2650d621 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.183816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:07.208938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459be7cf-da43-4a00-abc5-ea848883b2e3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:07.244255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:07.244796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.245078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.245353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.318389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63084e-e827-4400-9ef8-454e2650d621 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:07.325660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:07.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:07.335365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:07.359625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3987449-4140-414e-87d9-1e26c53c4c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:07.360429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3987449-4140-414e-87d9-1e26c53c4c09 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.360823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3987449-4140-414e-87d9-1e26c53c4c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.361107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3987449-4140-414e-87d9-1e26c53c4c09 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d/users/7d6febb46d1d4d2ea74959cb655ad9f0/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.363333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3987449-4140-414e-87d9-1e26c53c4c09 None admin] RBAC: Authorizing `identity:create_grant(project_id=258fc26104b542a6b4798666f4dd698d, user_id=7d6febb46d1d4d2ea74959cb655ad9f0, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:07.365035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3987449-4140-414e-87d9-1e26c53c4c09 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:07.388227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 61/118] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:07 2022] PUT /identity/v3/projects/258fc26104b542a6b4798666f4dd698d/users/7d6febb46d1d4d2ea74959cb655ad9f0/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:07.389767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edcd96-3ca0-4a41-8237-5c9c4f198978 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.390154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edcd96-3ca0-4a41-8237-5c9c4f198978 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.390442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edcd96-3ca0-4a41-8237-5c9c4f198978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.422862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-75edcd96-3ca0-4a41-8237-5c9c4f198978 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:07.424139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-75edcd96-3ca0-4a41-8237-5c9c4f198978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:07.460726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 58/119] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:07.462432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.519330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 62/120] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:07.520591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edcd96-3ca0-4a41-8237-5c9c4f198978 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.574456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:07.606387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:07.613635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f46d-110f-467e-87de-5872b0f10f9d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:07.654838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:07.656005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.656511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.657015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.667109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edcd96-3ca0-4a41-8237-5c9c4f198978 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:07.670833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:07.676101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:07.676933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:07.677692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:07.680072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 59/121] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:07.681068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.716401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:07.717063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.717349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.717630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.732770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:07.740373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:07.741300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 63/122] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:07.742059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.852761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:07.863000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1391-1005-4dfb-814f-999b1c32a06c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:07.877918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281101c-5342-410e-91d6-97e0e897ba3c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:07.902440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:07.903066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.903348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.903729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.904571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:07.904888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:07.906273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:07.915693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 64/123] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:07.915862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:07.916241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.916337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.916526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.916807 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.918021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:07.919578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:07.921241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 60/124] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:07 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:07.932148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:07.959751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.036610 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea02b6-3744-4245-a722-5fed5ea67d0c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.040956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97602d4e-5f07-403e-968c-3e0f80f817f7 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.078241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.079111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.079248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.079602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.079793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.080106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.080202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.080385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.081058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:08.081157 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] RBAC: Adding query filter params (role.id=5713af9e187348c7842eac08e8a75943, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=06250c854f60404191d5de14593a1ea5) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:08.081368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.081708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.082790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.083606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.090714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 61/125] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:07 2022] GET /identity/v3/role_assignments?user.id=06250c854f60404191d5de14593a1ea5&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=5713af9e187348c7842eac08e8a75943 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.091618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.102908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 65/126] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.103839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.158826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.269477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.280749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8e1c-e490-4bf5-b68c-bcc8f6bc0a28 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.300992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74914abc-14ba-4435-a804-54663c280bfb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.325311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.325963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.326252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.326532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.327685 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.329322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.331392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 62/127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.332221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.385854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.386518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.386781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.387058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.420775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:08.426778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:08.429641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 66/128] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:08.431550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.462149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b33879-d2df-4b25-9db4-894cd4cc247a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.499656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.500446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.500737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.501015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.502283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.503763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.505785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 63/129] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.506812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.538571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.606394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.621657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8348ec-1216-413e-bd74-e6d81cfd3c8f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.651021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c8bcf-e984-468c-8c71-3325e051fdbf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.657860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.658488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.658775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.659051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.659726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:08.660090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.661486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.670724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 64/130] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.671872 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.717751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.718404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.718828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.719107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.724665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.726314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.728318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 67/131] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.729261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.770847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.787450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b57d24-10dc-4b8b-b6e4-7dd3483835c1 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.822782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.823438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.823726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.824046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.826793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.826793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.828455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 65/132] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.829210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.878545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd06f-f53d-4e8a-bf58-c8ddce8c70be None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.917785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a4e6-ad82-4487-adf9-70bc2b4453a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.919144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a4e6-ad82-4487-adf9-70bc2b4453a8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.919858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a4e6-ad82-4487-adf9-70bc2b4453a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.920307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a4e6-ad82-4487-adf9-70bc2b4453a8 None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.922253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a4e6-ad82-4487-adf9-70bc2b4453a8 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.923918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a4e6-ad82-4487-adf9-70bc2b4453a8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.926463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 68/133] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.928151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52473-cbad-422b-9fe9-c4f04d1969e9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.929563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52473-cbad-422b-9fe9-c4f04d1969e9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.930120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e52473-cbad-422b-9fe9-c4f04d1969e9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.936340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 69/134] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:08.936906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e52473-cbad-422b-9fe9-c4f04d1969e9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.942377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de6250-98f2-42e3-b416-40c45672002c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.958195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.981036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.981809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.982433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.982553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d/users/1c3268fd2eb846f4bc4b8245f9be0583/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.984651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=258fc26104b542a6b4798666f4dd698d, user_id=1c3268fd2eb846f4bc4b8245f9be0583, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.986481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:09.008199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 66/135] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:08 2022] PUT /identity/v3/projects/258fc26104b542a6b4798666f4dd698d/users/1c3268fd2eb846f4bc4b8245f9be0583/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:09.013822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:09.048205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:09.104541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e52473-cbad-422b-9fe9-c4f04d1969e9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:09.142099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52ca4a-9548-4228-8eba-37335356cca9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:09.173965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:09.174891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:09.175312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:09.175726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d/users/1c3268fd2eb846f4bc4b8245f9be0583/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:09.179768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da633b4-6992-435c-a7cb-3a7334ba8466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:09.180588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da633b4-6992-435c-a7cb-3a7334ba8466 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:09.180979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da633b4-6992-435c-a7cb-3a7334ba8466 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:09.181364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da633b4-6992-435c-a7cb-3a7334ba8466 None admin] PATH_INFO: `/v3/projects/7f083105e30d440698fd9bc16b2dc2d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:09.182238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=258fc26104b542a6b4798666f4dd698d, user_id=1c3268fd2eb846f4bc4b8245f9be0583, role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:09.182775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da633b4-6992-435c-a7cb-3a7334ba8466 None admin] RBAC: Authorizing `identity:get_project(project_id=7f083105e30d440698fd9bc16b2dc2d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:09.184039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:09.184602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da633b4-6992-435c-a7cb-3a7334ba8466 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:09.186529 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 67/136] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:09 2022] GET /identity/v3/projects/7f083105e30d440698fd9bc16b2dc2d5 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:09.191254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0be6d3-b2fb-4782-ab26-8b19854e79b8 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:09.191254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0be6d3-b2fb-4782-ab26-8b19854e79b8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:09.191254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0be6d3-b2fb-4782-ab26-8b19854e79b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:09.212045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2f0be6d3-b2fb-4782-ab26-8b19854e79b8 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:09.213492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2f0be6d3-b2fb-4782-ab26-8b19854e79b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:09.226521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 70/137] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:08 2022] PUT /identity/v3/projects/258fc26104b542a6b4798666f4dd698d/users/1c3268fd2eb846f4bc4b8245f9be0583/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:09.227776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:09.294961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 68/138] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:09.358832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:09.403070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef012c-32ad-450e-8213-b798c856bfa9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:09.449679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:09.450291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:09.450591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:09.450866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] PATH_INFO: `/v3/projects/7f083105e30d440698fd9bc16b2dc2d5/users/1c3268fd2eb846f4bc4b8245f9be0583/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:09.452934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f083105e30d440698fd9bc16b2dc2d5, user_id=1c3268fd2eb846f4bc4b8245f9be0583, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:09.454405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:09.471542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 71/139] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:09 2022] PUT /identity/v3/projects/7f083105e30d440698fd9bc16b2dc2d5/users/1c3268fd2eb846f4bc4b8245f9be0583/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:09.648491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0be6d3-b2fb-4782-ab26-8b19854e79b8 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:09.664134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:09.753939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0be6d3-b2fb-4782-ab26-8b19854e79b8 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:09.790610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6010-5b62-4b4e-b5d1-eb0e68ccc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:09.791599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6010-5b62-4b4e-b5d1-eb0e68ccc86a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:09.792122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6010-5b62-4b4e-b5d1-eb0e68ccc86a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:09.792594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6010-5b62-4b4e-b5d1-eb0e68ccc86a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:09.793909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df6010-5b62-4b4e-b5d1-eb0e68ccc86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:09.795573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df6010-5b62-4b4e-b5d1-eb0e68ccc86a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:09.797688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 69/140] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:09.803496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:09.940509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9601-18ca-4faf-8206-730e272ab9f5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:09.972332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:09.977449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3933e5-3c53-4d2b-a360-1bcf799907c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:09.978081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3933e5-3c53-4d2b-a360-1bcf799907c3 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:09.978442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3933e5-3c53-4d2b-a360-1bcf799907c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:09.978751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3933e5-3c53-4d2b-a360-1bcf799907c3 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:09.979435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3933e5-3c53-4d2b-a360-1bcf799907c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:09.981578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3933e5-3c53-4d2b-a360-1bcf799907c3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:10.016182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 72/141] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:09 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:10.131414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5f2ff-88c0-432e-99f8-f6af66aed4a9 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:10.132199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5f2ff-88c0-432e-99f8-f6af66aed4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:10.132678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5f2ff-88c0-432e-99f8-f6af66aed4a9 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:10.134222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 70/142] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:10.139988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5988ed-82bc-41e4-8d08-65ed07339003 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:10.140284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5988ed-82bc-41e4-8d08-65ed07339003 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:10.140623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5988ed-82bc-41e4-8d08-65ed07339003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:10.162394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0a5988ed-82bc-41e4-8d08-65ed07339003 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:10.163718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0a5988ed-82bc-41e4-8d08-65ed07339003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:10.253994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 73/143] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:10.598395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b2b2-f699-492f-b4ef-d2a46373165d None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:10.599064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b2b2-f699-492f-b4ef-d2a46373165d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:10.599542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b2b2-f699-492f-b4ef-d2a46373165d None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:10.601391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 71/144] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:10.615715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984ea02-4f60-4524-b3e7-424398ade0f9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:10.616698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984ea02-4f60-4524-b3e7-424398ade0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:10.617208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984ea02-4f60-4524-b3e7-424398ade0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:10.644747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9984ea02-4f60-4524-b3e7-424398ade0f9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:10.646257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9984ea02-4f60-4524-b3e7-424398ade0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:10.736532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 74/145] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:10.852681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b2b2-f699-492f-b4ef-d2a46373165d None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:10.951062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:10.979206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0b2b2-f699-492f-b4ef-d2a46373165d None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:11.028827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:11.031480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.032020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.032734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.044881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:11.055269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:11.056194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:11.057215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:11.059567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 72/146] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:11.066145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984ea02-4f60-4524-b3e7-424398ade0f9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:11.144983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:11.218464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984ea02-4f60-4524-b3e7-424398ade0f9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:11.268693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:11.269691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.270170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.270660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.271547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:11.272132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:11.273883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:11.286044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 75/147] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:11.292125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:11.352926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:11.425955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65ac7a-dd39-42bf-8184-5488ab4d4cc4 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:11.472925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:11.474068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.474559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.475036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] PATH_INFO: `/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.478512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6febb46d1d4d2ea74959cb655ad9f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:11.480938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:11.483084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 73/148] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:11 2022] GET /identity/v3/users/7d6febb46d1d4d2ea74959cb655ad9f0 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:11.489301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:11.502632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:11.610223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749f186-e8fa-4705-a058-1e8ab263e1b7 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:11.652961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691afe2c-31bf-4f06-8050-a4b0281e99c7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:11.674827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:11.683211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:11.684265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.684765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.685247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.740617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:11.741459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.741795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.742035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.763081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:11.775848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:11.776796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:11.777595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:11.779960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 76/149] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:11.784071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:11.800075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:11.802049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:11.818365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:11.975896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 74/150] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:11.981487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ec415-1347-41e9-bec6-818d71ac56a9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:11.982077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.032591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc381d2-8ff1-4849-a04a-c5f2f3ac5336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.033233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc381d2-8ff1-4849-a04a-c5f2f3ac5336 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.033779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc381d2-8ff1-4849-a04a-c5f2f3ac5336 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.034210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc381d2-8ff1-4849-a04a-c5f2f3ac5336 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.035153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc381d2-8ff1-4849-a04a-c5f2f3ac5336 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:12.035670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc381d2-8ff1-4849-a04a-c5f2f3ac5336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.037295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc381d2-8ff1-4849-a04a-c5f2f3ac5336 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.051855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 77/151] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:12.054042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556001-6e2d-49d1-aa0e-1db2dc6a5259 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.054548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556001-6e2d-49d1-aa0e-1db2dc6a5259 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.055028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556001-6e2d-49d1-aa0e-1db2dc6a5259 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.057028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 78/152] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:12.061212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556001-6e2d-49d1-aa0e-1db2dc6a5259 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.110862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4efc0-cdd6-43db-a051-d21c130a09b2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.119657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.121965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.151007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a43597-0157-491e-b1ae-2f60d49b148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.151971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43597-0157-491e-b1ae-2f60d49b148e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.152410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43597-0157-491e-b1ae-2f60d49b148e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.152838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43597-0157-491e-b1ae-2f60d49b148e None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.155018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a43597-0157-491e-b1ae-2f60d49b148e None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.156668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a43597-0157-491e-b1ae-2f60d49b148e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.158507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 75/153] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:11 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:12.160596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd11a-a570-431f-9947-e707ad192201 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.161054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd11a-a570-431f-9947-e707ad192201 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.161484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfd11a-a570-431f-9947-e707ad192201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.181084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ddcfd11a-a570-431f-9947-e707ad192201 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:12.182555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ddcfd11a-a570-431f-9947-e707ad192201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:12.246703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556001-6e2d-49d1-aa0e-1db2dc6a5259 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.254945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 76/154] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:12.256146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd11a-a570-431f-9947-e707ad192201 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.308627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.309403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.309848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.310280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] PATH_INFO: `/v3/users/06250c854f60404191d5de14593a1ea5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.311606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] RBAC: Authorizing `identity:get_user(user_id=06250c854f60404191d5de14593a1ea5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.313332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.315103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 79/155] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/users/06250c854f60404191d5de14593a1ea5 => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:12.321573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.362246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcfd11a-a570-431f-9947-e707ad192201 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.371247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.408877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.409773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.410201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.410617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.411497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=7d6febb46d1d4d2ea74959cb655ad9f0) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:12.411998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.413812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.420489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 77/156] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/role_assignments?user.id=7d6febb46d1d4d2ea74959cb655ad9f0&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:12.512945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.515782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df979238-f08f-4139-a8f3-c4502c9d6b4d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.571278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874778a-b85c-4ef1-b71f-1c4502c0e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.571963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874778a-b85c-4ef1-b71f-1c4502c0e8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.572256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874778a-b85c-4ef1-b71f-1c4502c0e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.572530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874778a-b85c-4ef1-b71f-1c4502c0e8a4 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.576728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874778a-b85c-4ef1-b71f-1c4502c0e8a4 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.578222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874778a-b85c-4ef1-b71f-1c4502c0e8a4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.580185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 80/157] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:12.586636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.586810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fa8e-78e9-4b05-b31f-5ca7895f5a36 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.586810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fa8e-78e9-4b05-b31f-5ca7895f5a36 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.587389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032fa8e-78e9-4b05-b31f-5ca7895f5a36 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.588373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 81/158] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:12.618432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b640b-6e47-4cbe-af5c-a2637e7acd8d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.618698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b640b-6e47-4cbe-af5c-a2637e7acd8d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.618985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b640b-6e47-4cbe-af5c-a2637e7acd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.661178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-549b640b-6e47-4cbe-af5c-a2637e7acd8d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:12.662121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-549b640b-6e47-4cbe-af5c-a2637e7acd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:12.718187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f2e23-f21a-436d-aaa7-2427dabdfb61 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.757342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.758959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.759400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.759851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d/users/06250c854f60404191d5de14593a1ea5/roles/5713af9e187348c7842eac08e8a75943` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.762230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=258fc26104b542a6b4798666f4dd698d, user_id=06250c854f60404191d5de14593a1ea5, role_id=5713af9e187348c7842eac08e8a75943)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.763952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.794376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 78/159] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:12 2022] PUT /identity/v3/projects/258fc26104b542a6b4798666f4dd698d/users/06250c854f60404191d5de14593a1ea5/roles/5713af9e187348c7842eac08e8a75943 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:12.795573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.857597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.875839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 82/160] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:12.964650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fcb52-1826-42ac-8ae7-035f930066e0 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.008122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.008783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.009047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.009322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.027686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:13.032506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:13.033368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:13.034186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 79/161] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:13.040219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b640b-6e47-4cbe-af5c-a2637e7acd8d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.152244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.155790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b640b-6e47-4cbe-af5c-a2637e7acd8d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.195956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.196577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.196861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.197134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.197815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:13.198120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.199492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.212373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 83/162] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:13.217945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.318546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.330401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d61303-2164-4aa2-ab5c-79dafc5ff010 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.338303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.384039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da72a9-93e0-4a46-9206-1a9c827eb000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.384666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da72a9-93e0-4a46-9206-1a9c827eb000 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.384951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da72a9-93e0-4a46-9206-1a9c827eb000 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.385230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da72a9-93e0-4a46-9206-1a9c827eb000 None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.392533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da72a9-93e0-4a46-9206-1a9c827eb000 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.394035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da72a9-93e0-4a46-9206-1a9c827eb000 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.395754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 80/163] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:13.396962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b42b-9c3d-43c3-9e4f-ebd7250c9743 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.397256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b42b-9c3d-43c3-9e4f-ebd7250c9743 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.397530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2b42b-9c3d-43c3-9e4f-ebd7250c9743 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.398988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 81/164] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:13.404003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe43b50-16b7-4738-98f2-daab4d6400de None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.404303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe43b50-16b7-4738-98f2-daab4d6400de None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.404563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe43b50-16b7-4738-98f2-daab4d6400de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.432747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cfe43b50-16b7-4738-98f2-daab4d6400de None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:13.434010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cfe43b50-16b7-4738-98f2-daab4d6400de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:13.450857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70304701-05a7-44ac-bc73-93fecb005000 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.486654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.487648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.488173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.488664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.500380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:13.507044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:13.507996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:13.508788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:13.511480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 84/165] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:13.516922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.542659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.602335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 82/166] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:13.603247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe43b50-16b7-4738-98f2-daab4d6400de None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.751518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2faed-8262-443a-bc2a-5e0bee399eb0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.795967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.836731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.837485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe43b50-16b7-4738-98f2-daab4d6400de None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.837568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.837643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.837965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.898075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.898787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.899070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.899346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.900051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:13.900365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.901809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.915672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 83/167] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:13.921430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.992048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.996132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.029249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.139716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824b368-e44f-47ec-9d47-59101e248371 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.157329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 85/168] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:14.158877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.225431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.226082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.226366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.226647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.232527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:14.234056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.235661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 84/169] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:14.236523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.270071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.343598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1da67f-0ac9-48c5-a5f3-c96381609da6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.389838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.419870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.420924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.422499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.424205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.436815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acc95a-4b2d-4edb-a515-de3d0fb6b941 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.454685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:14.460728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:14.461604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:14.462383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:14.469598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 86/170] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:14.470688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.486335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.486992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.487277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.487556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.488751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:14.490282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.493255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 85/171] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:14 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:14.494023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.595564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.614626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285f0c-c83d-4230-8078-7d7939406bb3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.654676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.656121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.656412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.656695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.657379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:14.657689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:14.659102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.670686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 86/172] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:14.671523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.733942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd916ce-5eb1-4808-a54b-8da104e72422 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.792947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fcbc5-115b-44c5-82ec-8bc98b8078b5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.831581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.832231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.832515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.832793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.833250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0b8b-cc3a-4238-ad45-05f021f58e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.833690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=1c3268fd2eb846f4bc4b8245f9be0583) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:14.833876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:14.835212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0b8b-cc3a-4238-ad45-05f021f58e4e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.835696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0b8b-cc3a-4238-ad45-05f021f58e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.836197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0b8b-cc3a-4238-ad45-05f021f58e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.837052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.856367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 87/173] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:14 2022] GET /identity/v3/role_assignments?user.id=1c3268fd2eb846f4bc4b8245f9be0583&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:14.857227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.887833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.988164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.999123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5313fae-9400-4004-8982-eec85f239218 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:15.033662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0b8b-cc3a-4238-ad45-05f021f58e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:15.035139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0b8b-cc3a-4238-ad45-05f021f58e4e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:15.077234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68714ac-32e6-4ecc-a9d9-9a2a7c81c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:15.077899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68714ac-32e6-4ecc-a9d9-9a2a7c81c850 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.078181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68714ac-32e6-4ecc-a9d9-9a2a7c81c850 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.078464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68714ac-32e6-4ecc-a9d9-9a2a7c81c850 None admin] PATH_INFO: `/v3/users/1c3268fd2eb846f4bc4b8245f9be0583` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.080853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68714ac-32e6-4ecc-a9d9-9a2a7c81c850 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3268fd2eb846f4bc4b8245f9be0583)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:15.082446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68714ac-32e6-4ecc-a9d9-9a2a7c81c850 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:15.084538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 88/174] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:14 2022] GET /identity/v3/users/1c3268fd2eb846f4bc4b8245f9be0583 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:15.086001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcb485-ead0-4afe-97fd-6dd0052b3753 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.086290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcb485-ead0-4afe-97fd-6dd0052b3753 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.086567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcb485-ead0-4afe-97fd-6dd0052b3753 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.088206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 89/175] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:15.093031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcb485-ead0-4afe-97fd-6dd0052b3753 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:15.153916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 87/176] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:15.155230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8677f9-1a43-4c1e-b207-7fb67a88be77 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.155522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8677f9-1a43-4c1e-b207-7fb67a88be77 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.155822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8677f9-1a43-4c1e-b207-7fb67a88be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.182175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ec8677f9-1a43-4c1e-b207-7fb67a88be77 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:15.183403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ec8677f9-1a43-4c1e-b207-7fb67a88be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:15.242335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:15.257121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 88/177] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:15.257825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8677f9-1a43-4c1e-b207-7fb67a88be77 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:15.281558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:15.282798 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcb485-ead0-4afe-97fd-6dd0052b3753 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:15.347743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34432860-3a83-4ece-a5d1-3a751e748bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:15.348380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34432860-3a83-4ece-a5d1-3a751e748bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.348658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34432860-3a83-4ece-a5d1-3a751e748bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.348930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34432860-3a83-4ece-a5d1-3a751e748bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.429262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8677f9-1a43-4c1e-b207-7fb67a88be77 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:15.453590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34432860-3a83-4ece-a5d1-3a751e748bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:15.454809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34432860-3a83-4ece-a5d1-3a751e748bc5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:15.487710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898638f-d9fb-4dea-8a3d-27fd6df9d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:15.488270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898638f-d9fb-4dea-8a3d-27fd6df9d11a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.488551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898638f-d9fb-4dea-8a3d-27fd6df9d11a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.488829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898638f-d9fb-4dea-8a3d-27fd6df9d11a None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.490286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898638f-d9fb-4dea-8a3d-27fd6df9d11a None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:15.493882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898638f-d9fb-4dea-8a3d-27fd6df9d11a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:15.494378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 89/178] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:15 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:15.495731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d4411-2709-4fa8-aa7a-ed5ca4bcebee None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.496050 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d4411-2709-4fa8-aa7a-ed5ca4bcebee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.496483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d4411-2709-4fa8-aa7a-ed5ca4bcebee None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.501126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 90/179] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:15.501126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387816b-b7ec-4c70-a1d1-6164cf1a5d98 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.501126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387816b-b7ec-4c70-a1d1-6164cf1a5d98 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.501126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387816b-b7ec-4c70-a1d1-6164cf1a5d98 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.501126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 91/180] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:15.501750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387816b-b7ec-4c70-a1d1-6164cf1a5d98 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:15.566638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:15.589033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 90/181] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:15.590587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe9fe-c51b-47f9-bfe4-8a1b5dbc53f4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.590873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe9fe-c51b-47f9-bfe4-8a1b5dbc53f4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.591219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe9fe-c51b-47f9-bfe4-8a1b5dbc53f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.602999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:15.609938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5ecbe9fe-c51b-47f9-bfe4-8a1b5dbc53f4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:15.611137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5ecbe9fe-c51b-47f9-bfe4-8a1b5dbc53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:15.628119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387816b-b7ec-4c70-a1d1-6164cf1a5d98 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:15.664809 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317b94-d7d0-482c-9c66-2be8dea6afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:15.665426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317b94-d7d0-482c-9c66-2be8dea6afad None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.665711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317b94-d7d0-482c-9c66-2be8dea6afad None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.665988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317b94-d7d0-482c-9c66-2be8dea6afad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.666723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317b94-d7d0-482c-9c66-2be8dea6afad None admin] RBAC: Adding query filter params (role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=1c3268fd2eb846f4bc4b8245f9be0583) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:15.667032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317b94-d7d0-482c-9c66-2be8dea6afad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:15.668508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317b94-d7d0-482c-9c66-2be8dea6afad None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:15.683131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 92/182] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:15 2022] GET /identity/v3/role_assignments?user.id=1c3268fd2eb846f4bc4b8245f9be0583&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:15.683131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396c497-076f-477c-bfd4-329ad89f2a1d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.683131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396c497-076f-477c-bfd4-329ad89f2a1d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.683131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396c497-076f-477c-bfd4-329ad89f2a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.696916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 91/183] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:15.697789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe9fe-c51b-47f9-bfe4-8a1b5dbc53f4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:15.697905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2396c497-076f-477c-bfd4-329ad89f2a1d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:15.699120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2396c497-076f-477c-bfd4-329ad89f2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:15.776152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 93/184] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:15.776927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396c497-076f-477c-bfd4-329ad89f2a1d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:15.877575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe9fe-c51b-47f9-bfe4-8a1b5dbc53f4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:15.899043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:15.936309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:15.944796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01c055-4328-400e-b58d-cc9d5c779148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:15.947098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c055-4328-400e-b58d-cc9d5c779148 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.947480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c055-4328-400e-b58d-cc9d5c779148 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.948743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01c055-4328-400e-b58d-cc9d5c779148 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.965711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01c055-4328-400e-b58d-cc9d5c779148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1c01c055-4328-400e-b58d-cc9d5c779148 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:15.970584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:15.971448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:15.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:15.972860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396c497-076f-477c-bfd4-329ad89f2a1d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:15.972937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 92/185] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:15.972937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a084f7-cd86-4942-88ae-2bf840fd30ac None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.973801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a084f7-cd86-4942-88ae-2bf840fd30ac None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.973801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a084f7-cd86-4942-88ae-2bf840fd30ac None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:15.974896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 93/186] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:15.980825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ed90-a2e9-4d60-9f46-d0747e8bf330 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:15.981109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ed90-a2e9-4d60-9f46-d0747e8bf330 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:15.981386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74ed90-a2e9-4d60-9f46-d0747e8bf330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.004944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5a74ed90-a2e9-4d60-9f46-d0747e8bf330 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:16.006237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5a74ed90-a2e9-4d60-9f46-d0747e8bf330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:16.027861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.028445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.028724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.028996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] PATH_INFO: `/v3/projects/7f083105e30d440698fd9bc16b2dc2d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.032537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] RBAC: Authorizing `identity:get_project(project_id=7f083105e30d440698fd9bc16b2dc2d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.034425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.036621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 94/187] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:15 2022] GET /identity/v3/projects/7f083105e30d440698fd9bc16b2dc2d5 => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.038371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.087538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 94/188] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:16.089025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ed90-a2e9-4d60-9f46-d0747e8bf330 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.164704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea893962-bc3f-472c-b8ed-10c03e693251 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.204036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.204843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.205359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.205856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.207121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:16.208756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.208917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.223331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.224120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 95/189] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.227014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74ed90-a2e9-4d60-9f46-d0747e8bf330 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.229430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.232485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.266831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.267443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.267721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.268018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.268749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=7f083105e30d440698fd9bc16b2dc2d5, user.id=1c3268fd2eb846f4bc4b8245f9be0583) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:16.269056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.270564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.283643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/role_assignments?user.id=1c3268fd2eb846f4bc4b8245f9be0583&scope.project.id=7f083105e30d440698fd9bc16b2dc2d5&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.284577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.343995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e984a29-6f7d-4469-adce-180c48c2369a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.384470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.385126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.385411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.385689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.397395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:16.402816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:16.403770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:16.404606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:16.408847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 96/191] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:16.409745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.426144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9be15-bef7-4876-9a7e-536da5f3f65a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.468714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.469363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.469651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.469928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.471074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.472570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.474306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 96/192] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.474943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.486617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.521134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.534156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5a558-78be-4cdf-9b6f-5aa6721f0990 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.567746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.568420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.569285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.569563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] PATH_INFO: `/v3/users/1e4e1148320d45bd97d7a140ffa9f27b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.582829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] RBAC: Authorizing `identity:get_user(user_id=1e4e1148320d45bd97d7a140ffa9f27b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.584457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.586833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 97/193] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/users/1e4e1148320d45bd97d7a140ffa9f27b => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.587423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.590530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b1c1-1f71-4381-a987-22874edfd3c7 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.623552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.624207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.624490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.624764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.636224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:16.641467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:16.642506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 97/194] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:16.643326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.689096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf48f1-d754-4ae4-a8c4-86cb45351c0a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.711112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.725841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.726451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.726732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.727007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.727674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:16.728009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.729375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.734538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.737571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 98/195] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.737571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.748955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aed50-4577-408a-9e88-95408861a8d2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.782775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164062d8-0361-4396-8733-3878df309956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.783410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164062d8-0361-4396-8733-3878df309956 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.783682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164062d8-0361-4396-8733-3878df309956 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.784297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164062d8-0361-4396-8733-3878df309956 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.784619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164062d8-0361-4396-8733-3878df309956 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.786073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164062d8-0361-4396-8733-3878df309956 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.806453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 98/196] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:16 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:16.812936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164062d8-0361-4396-8733-3878df309956 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.844870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796310b7-8aa1-4c5a-b0be-29794aac33ea None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.887253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.887943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.888220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.888496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.936178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164062d8-0361-4396-8733-3878df309956 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.941873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.966823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.967727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.981289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.981925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.982212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.983640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.983640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:16.983640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.985543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.996397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 99/197] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.997239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.011349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.100690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 99/198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:17.101608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.144209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f12d-e323-4f94-84b4-c3a5ef1fd253 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.190500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.191160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.191440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.191718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] PATH_INFO: `/v3/users/1e4e1148320d45bd97d7a140ffa9f27b` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.192923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] RBAC: Authorizing `identity:get_user(user_id=1e4e1148320d45bd97d7a140ffa9f27b)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.194938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.196629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 100/199] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/users/1e4e1148320d45bd97d7a140ffa9f27b => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:17.197883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.216192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.226336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67742ea8-537b-4654-b497-0c8e75ed1d2f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.264400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.265415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.265963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.266427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] PATH_INFO: `/v3/users/06250c854f60404191d5de14593a1ea5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.267763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] RBAC: Authorizing `identity:get_user(user_id=06250c854f60404191d5de14593a1ea5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.269885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.272280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 100/200] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/users/06250c854f60404191d5de14593a1ea5 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:17.273612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.302329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.331024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed9b9e-86be-4a5b-bf24-0562618079a7 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.380752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.382011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.382861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.383148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.384592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.386318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.389126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 101/201] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:17.390113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.395048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1a43-933e-43ab-a6e3-0b119ce4e95d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.436069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.436977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.437425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.437894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.460176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.519556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.521599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.526915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cdd00-bb72-42eb-a733-9939f9edea9a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.565839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.566457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.566737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.567010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.583903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.637861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.639250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.640319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 101/202] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:17.641545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.697686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.745889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 102/203] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:17.746831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.755097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e12b1-8d0e-45d6-9a0f-8bef86a926de None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.794059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.795048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.795498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.796059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.796993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=1e4e1148320d45bd97d7a140ffa9f27b) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:17.797483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.799455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.800501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.807982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 102/204] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/role_assignments?user.id=1e4e1148320d45bd97d7a140ffa9f27b&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:17.809592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.863169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226e2cf-a994-4ba6-9270-5d5ccbde1be6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.907747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.908670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.909119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.909538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.910971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.912830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.914818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 103/205] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:17.922191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.933541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231655d-710a-46ae-8e18-a86365268f90 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.957087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:18.000784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:18.001739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:18.002542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:18.002542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:18.005992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:18.008496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:18.010428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 103/206] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:18.016651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:18.040998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1d20f-3b09-4382-bd7a-e255d4029657 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:18.057624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:18.079462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f002aa-40de-41d9-9aee-904f53ffd7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:18.080357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f002aa-40de-41d9-9aee-904f53ffd7ce None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:18.080767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f002aa-40de-41d9-9aee-904f53ffd7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:18.081202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f002aa-40de-41d9-9aee-904f53ffd7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:18.082074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f002aa-40de-41d9-9aee-904f53ffd7ce None admin] RBAC: Adding query filter params (role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=1e4e1148320d45bd97d7a140ffa9f27b) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:18.082512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f002aa-40de-41d9-9aee-904f53ffd7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:18.084174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f002aa-40de-41d9-9aee-904f53ffd7ce None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:18.090881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 104/207] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/role_assignments?user.id=1e4e1148320d45bd97d7a140ffa9f27b&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:18.179111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff919-e189-46a4-a4bb-16db946f7f1d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:18.223003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f606f76-6389-4823-89b2-acddbf1d6c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:18.223638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f606f76-6389-4823-89b2-acddbf1d6c19 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:18.223971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f606f76-6389-4823-89b2-acddbf1d6c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:18.224252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f606f76-6389-4823-89b2-acddbf1d6c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:18.225070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f606f76-6389-4823-89b2-acddbf1d6c19 None admin] RBAC: Adding query filter params (role.id=5713af9e187348c7842eac08e8a75943, scope.project.id=258fc26104b542a6b4798666f4dd698d, user.id=06250c854f60404191d5de14593a1ea5) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:18.225437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f606f76-6389-4823-89b2-acddbf1d6c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:18.227645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f606f76-6389-4823-89b2-acddbf1d6c19 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:18.235032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 104/208] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:18 2022] GET /identity/v3/role_assignments?user.id=06250c854f60404191d5de14593a1ea5&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=5713af9e187348c7842eac08e8a75943 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:18.981475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22a2d-ffdb-4b7f-be8e-98c7f8b7d046 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:18.982454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22a2d-ffdb-4b7f-be8e-98c7f8b7d046 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:18.982936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb22a2d-ffdb-4b7f-be8e-98c7f8b7d046 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:18.984756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 105/209] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:18.989947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc8c9a-6d70-4f5b-895d-b7feb8f76d7c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:18.990398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc8c9a-6d70-4f5b-895d-b7feb8f76d7c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:18.990648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc8c9a-6d70-4f5b-895d-b7feb8f76d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.010087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8fbc8c9a-6d70-4f5b-895d-b7feb8f76d7c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:19.011284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8fbc8c9a-6d70-4f5b-895d-b7feb8f76d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:19.054585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:19.060745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dba665-2160-49ba-98eb-8c9e523a015b None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.061179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dba665-2160-49ba-98eb-8c9e523a015b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.061534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dba665-2160-49ba-98eb-8c9e523a015b None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.062961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 106/210] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:19.067835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a835be-65e3-47f4-aab3-6aad4a7ce90f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.068214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a835be-65e3-47f4-aab3-6aad4a7ce90f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.068597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a835be-65e3-47f4-aab3-6aad4a7ce90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.087670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a1a835be-65e3-47f4-aab3-6aad4a7ce90f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:19.087963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 105/211] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:19.089017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a1a835be-65e3-47f4-aab3-6aad4a7ce90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:19.158400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 107/212] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:19.357951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc8c9a-6d70-4f5b-895d-b7feb8f76d7c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:19.434748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a835be-65e3-47f4-aab3-6aad4a7ce90f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:19.457491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc8c9a-6d70-4f5b-895d-b7feb8f76d7c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:19.493982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:19.494903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.495357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.495884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.511396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:19.517393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:19.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:19.519057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 106/213] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:19.527403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:19.549239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a835be-65e3-47f4-aab3-6aad4a7ce90f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:19.572199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:19.579064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:19.594948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:19.595578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.595909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.596187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.597417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:19.598972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:19.605863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 108/214] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:19.606810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:19.674828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb844d-e862-432e-8c10-d2a2c8782eaf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:19.716169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:19.717196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.717551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.718059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.718822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:19.719130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:19.720971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:19.724269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6423cbb-b758-43ae-8047-72ae8d5e6d19 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:19.732247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 107/215] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:19.737670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:19.773809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:19.775889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.776411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.776859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.777701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:19.779343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:19.816275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 109/216] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:19 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:02:19.873049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:19.878331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d63ed-846a-49f5-950c-44e659a47816 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:19.927588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87749dfe-787a-4029-929b-62263cf387c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:19.928324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749dfe-787a-4029-929b-62263cf387c9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.928608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749dfe-787a-4029-929b-62263cf387c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.928887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749dfe-787a-4029-929b-62263cf387c9 None admin] PATH_INFO: `/v3/users/eb46a77364634d8aaf1c3e4dde6058dc` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.944900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87749dfe-787a-4029-929b-62263cf387c9 None admin] RBAC: Authorizing `identity:get_user(user_id=eb46a77364634d8aaf1c3e4dde6058dc)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:19.946381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87749dfe-787a-4029-929b-62263cf387c9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:19.949033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 108/217] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:19 2022] GET /identity/v3/users/eb46a77364634d8aaf1c3e4dde6058dc => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:19.954870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:19.994289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:20.084729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb4fb4-9b0c-4388-a9ac-74eaa7dbbf66 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:20.126571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:20.127208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.127496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.127782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.151905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9154-7e3b-4b57-8fae-b7a77a593a93 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.152411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9154-7e3b-4b57-8fae-b7a77a593a93 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.152411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d9154-7e3b-4b57-8fae-b7a77a593a93 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.153794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 109/218] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:20.160291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90a71c-5ef9-4c74-8fe7-9fd5dac5c3da None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.160577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90a71c-5ef9-4c74-8fe7-9fd5dac5c3da None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.160856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90a71c-5ef9-4c74-8fe7-9fd5dac5c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.192178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4a90a71c-5ef9-4c74-8fe7-9fd5dac5c3da None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:20.193318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4a90a71c-5ef9-4c74-8fe7-9fd5dac5c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:20.219918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:20.221864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:20.261791 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:20.278616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 110/219] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:20.279954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce629-3062-460a-acbc-41e22a412ad3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.280344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce629-3062-460a-acbc-41e22a412ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.280623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce629-3062-460a-acbc-41e22a412ad3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.282130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 111/220] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:20.301974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8227a2-e214-4d99-ada4-3a8963a74f80 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.302262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8227a2-e214-4d99-ada4-3a8963a74f80 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.302583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8227a2-e214-4d99-ada4-3a8963a74f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.328424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9a8227a2-e214-4d99-ada4-3a8963a74f80 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:20.329618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9a8227a2-e214-4d99-ada4-3a8963a74f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:20.401094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 110/221] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:20.407510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:20.467887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 112/222] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:20.560277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba808f-8598-40aa-98e6-2ef008478a7e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:20.588491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8227a2-e214-4d99-ada4-3a8963a74f80 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:20.607560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:20.616382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:20.618023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.618310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.618589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.619942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:20.621410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:20.623215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 111/223] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:20 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:20.625724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:20.630873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:20.749411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8227a2-e214-4d99-ada4-3a8963a74f80 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:20.791241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:20.793299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.794771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.795404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.819515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:20.827321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:20.828241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:20.829027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:20.831309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 113/224] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:20.840122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:20.846741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c4f7-759d-4b53-b3ec-fa9a647b599e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:20.901907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:20.902408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.902694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.903027 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.903856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=eb46a77364634d8aaf1c3e4dde6058dc) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:20.904232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:20.905770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:20.916392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 112/225] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:20 2022] GET /identity/v3/role_assignments?user.id=eb46a77364634d8aaf1c3e4dde6058dc&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:20.916392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:20.960045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:20.988083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea880ee-35a9-4c9f-8fec-680472fa63c3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.031889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.032484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.032765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.033041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.046808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:21.052718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:21.054534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:21.055338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 114/226] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:21.060727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:21.110308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:21.156410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14601e4a-a56b-46d9-907e-af181c02880a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.179222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106193d8-e92f-4640-9343-c266efb78c84 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.195532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.212521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.212831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.213066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.213869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:21.214182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:21.215601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:21.228441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 113/227] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:21.235584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.236523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.237024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.237497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.238380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:21.238885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:21.241025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:21.241546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:21.248078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:21.254195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 115/228] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:21.261288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:21.401315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e3f1c-dddd-4a9e-8271-873fc4ec757c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.437763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.438573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.439331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.439451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] PATH_INFO: `/v3/users/1e4e1148320d45bd97d7a140ffa9f27b` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.440742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] RBAC: Authorizing `identity:get_user(user_id=1e4e1148320d45bd97d7a140ffa9f27b)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:21.442412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:21.444699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 114/229] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:21 2022] GET /identity/v3/users/1e4e1148320d45bd97d7a140ffa9f27b => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:21.445000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:21.455833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:21.461756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598e747-cd7d-4a6d-98e8-05cbca3353ab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.513458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.514356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.514786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.515208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] PATH_INFO: `/v3/users/1e4e1148320d45bd97d7a140ffa9f27b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.517912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] RBAC: Authorizing `identity:get_user(user_id=1e4e1148320d45bd97d7a140ffa9f27b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:21.520602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:21.526709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 116/230] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:21 2022] GET /identity/v3/users/1e4e1148320d45bd97d7a140ffa9f27b => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:21.533529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:21.602320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b3fc-8c04-4bd9-b111-7bc8424df6b5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.639139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.639967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.640327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.640679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.641956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:21.643662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:21.645894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 115/231] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:21 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:21.651608 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:21.656478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:21.708911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5e40-dccb-4d31-944b-04b5f8316667 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.745000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.745655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.745932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.746206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.747328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:21.748813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:21.750448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 117/232] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:21 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:21.753840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:21.758871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:21.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f005-6514-4cba-bd74-489267fbe902 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.900770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af10dba-0367-4aac-b76f-99b27674ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.901448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10dba-0367-4aac-b76f-99b27674ab5e None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.901787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10dba-0367-4aac-b76f-99b27674ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.902010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10dba-0367-4aac-b76f-99b27674ab5e None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/1e4e1148320d45bd97d7a140ffa9f27b/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:21.904041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af10dba-0367-4aac-b76f-99b27674ab5e None admin] RBAC: Authorizing `identity:create_grant(project_id=365cf2fc54cd42cf94babc9a50eeab9f, user_id=1e4e1148320d45bd97d7a140ffa9f27b, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:21.905491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af10dba-0367-4aac-b76f-99b27674ab5e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:21.931713 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 116/233] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:21 2022] PUT /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/1e4e1148320d45bd97d7a140ffa9f27b/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:21.946745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9506e0a-080b-4eab-b651-c192e074a363 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:21.996721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cd341-7bab-4dcd-97c2-7b821a23bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:21.997584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd341-7bab-4dcd-97c2-7b821a23bcf4 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:21.997872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd341-7bab-4dcd-97c2-7b821a23bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:21.998151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cd341-7bab-4dcd-97c2-7b821a23bcf4 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/1e4e1148320d45bd97d7a140ffa9f27b/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:22.000557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cd341-7bab-4dcd-97c2-7b821a23bcf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=365cf2fc54cd42cf94babc9a50eeab9f, user_id=1e4e1148320d45bd97d7a140ffa9f27b, role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:22.002202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cd341-7bab-4dcd-97c2-7b821a23bcf4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:22.004862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:22.021237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 118/234] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:21 2022] PUT /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/1e4e1148320d45bd97d7a140ffa9f27b/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:22.260476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe757d6-2edc-489f-90ec-9a1fb96353d7 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:22.261402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe757d6-2edc-489f-90ec-9a1fb96353d7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:22.261893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe757d6-2edc-489f-90ec-9a1fb96353d7 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:22.263451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 117/235] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:22.269054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64ff1-e868-4411-ab6d-4bf60e59cf34 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:22.269476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64ff1-e868-4411-ab6d-4bf60e59cf34 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:22.269674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64ff1-e868-4411-ab6d-4bf60e59cf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:22.288040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f73a-14b1-470b-830f-09265626d8c0 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:22.288663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f73a-14b1-470b-830f-09265626d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:22.289162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f73a-14b1-470b-830f-09265626d8c0 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:22.290765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 118/236] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:22.296131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ffb64ff1-e868-4411-ab6d-4bf60e59cf34 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:22.296659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df822-69d6-4211-bdda-cc37b3792620 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:22.297141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df822-69d6-4211-bdda-cc37b3792620 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:22.297347 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ffb64ff1-e868-4411-ab6d-4bf60e59cf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:22.297840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df822-69d6-4211-bdda-cc37b3792620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:22.332964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c67df822-69d6-4211-bdda-cc37b3792620 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:22.335179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c67df822-69d6-4211-bdda-cc37b3792620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:22.399239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 119/237] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:22.442405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 119/238] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:22.729162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64ff1-e868-4411-ab6d-4bf60e59cf34 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:22.845378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64ff1-e868-4411-ab6d-4bf60e59cf34 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:22.858285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df822-69d6-4211-bdda-cc37b3792620 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:22.878959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:22.908514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:22.909173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:22.909454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:22.909732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:22.920827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:22.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:22.926771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:22.927548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:22.931074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 120/239] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:22.936560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:22.952596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:23.027752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df822-69d6-4211-bdda-cc37b3792620 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:23.066627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:23.067450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:23.067733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:23.068041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:23.070450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:23.071932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:23.073520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 120/240] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:23.081920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:23.143680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6773f6-36c3-442b-9378-79677d22c0fa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:23.211156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:23.211788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:23.212091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:23.212371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:23.214114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:23.214425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:23.216081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:23.236824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 121/241] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:23.246311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:23.273994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4666a33-95c0-4fbb-80a4-28f82e4e4664 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:23.298284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:23.302227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:23.316484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a429b-7905-45f0-acc0-ed8c3c278727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:23.317388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a429b-7905-45f0-acc0-ed8c3c278727 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:23.317860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a429b-7905-45f0-acc0-ed8c3c278727 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:23.318314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a429b-7905-45f0-acc0-ed8c3c278727 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:23.319220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a429b-7905-45f0-acc0-ed8c3c278727 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:23.320941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a429b-7905-45f0-acc0-ed8c3c278727 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:23.344900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 121/242] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:23 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:23.347232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195725-6a1d-4a1f-97a8-17b85e7313eb None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:23.347837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195725-6a1d-4a1f-97a8-17b85e7313eb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:23.348370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07195725-6a1d-4a1f-97a8-17b85e7313eb None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:23.351208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 122/243] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:23.361501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9b2e-cb18-43ba-860c-932a9a5660bb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:23.361833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9b2e-cb18-43ba-860c-932a9a5660bb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:23.362222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c9b2e-cb18-43ba-860c-932a9a5660bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:23.389870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422d3f-f69c-4b8c-bcc4-754a0646700d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:23.407758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-128c9b2e-cb18-43ba-860c-932a9a5660bb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:23.411244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-128c9b2e-cb18-43ba-860c-932a9a5660bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:23.469241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:23.469898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:23.470181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:23.470457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] PATH_INFO: `/v3/users/befa0c34d6f84e7b8d86f6b19bda4339` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:23.497824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] RBAC: Authorizing `identity:get_user(user_id=befa0c34d6f84e7b8d86f6b19bda4339)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:23.499360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:23.501571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 122/244] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:23 2022] GET /identity/v3/users/befa0c34d6f84e7b8d86f6b19bda4339 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:23.509250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:23.540197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 123/245] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:23.625193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd156d-50a5-4f51-b129-ec2931f263fd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:23.627624 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:23.663280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:23.663926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:23.664208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:23.664483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:23.736153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:23.737613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:23.860928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 123/246] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:23.866846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c9b2e-cb18-43ba-860c-932a9a5660bb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:23.936650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:23.941502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.003967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c9b2e-cb18-43ba-860c-932a9a5660bb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.015407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.054895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.055553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.055843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.056121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.057823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:24.059745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:24.062408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 124/247] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:23 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:24.068132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.085943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c02d-8973-4ee6-bb3c-c45bcc1ab2ba None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.125255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.125894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.126173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.126445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.139009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:24.144036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:24.144896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:24.145680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 124/248] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:24.152329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.177192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140db20-7451-4f3b-8165-e122af5c4a3b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.214747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.215288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.215567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.215860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.216599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] RBAC: Adding query filter params (role.id=5713af9e187348c7842eac08e8a75943, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=befa0c34d6f84e7b8d86f6b19bda4339) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:24.216903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:24.218365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:24.223980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.224791 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 125/249] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/role_assignments?user.id=befa0c34d6f84e7b8d86f6b19bda4339&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=5713af9e187348c7842eac08e8a75943 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:24.271228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e92a6-4f74-44c6-aaad-f39601e6c5e5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.318047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed2ad-7b12-4877-a65b-b156cf4107f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.318047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed2ad-7b12-4877-a65b-b156cf4107f8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.318047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed2ad-7b12-4877-a65b-b156cf4107f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.318047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed2ad-7b12-4877-a65b-b156cf4107f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.319924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed2ad-7b12-4877-a65b-b156cf4107f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:24.319924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed2ad-7b12-4877-a65b-b156cf4107f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:24.319924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed2ad-7b12-4877-a65b-b156cf4107f8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:24.329014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 125/250] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:24.334677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.349539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd854-b88a-4df3-96de-07e7f0e30dda None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.350208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd854-b88a-4df3-96de-07e7f0e30dda None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.350890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bd854-b88a-4df3-96de-07e7f0e30dda None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.352519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 126/251] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:24.358356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc529f4-6432-47e8-a9e3-008867b25f5d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.358887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc529f4-6432-47e8-a9e3-008867b25f5d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.359333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc529f4-6432-47e8-a9e3-008867b25f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.389345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-efc529f4-6432-47e8-a9e3-008867b25f5d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:24.391015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-efc529f4-6432-47e8-a9e3-008867b25f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:24.419123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.500767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 127/252] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:24.513032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03015d3-31a6-4e4b-8746-4ff77f4bca5a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.549172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33222e-e4ea-4d1c-bc12-324522f0ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.550076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33222e-e4ea-4d1c-bc12-324522f0ea6c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.550495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33222e-e4ea-4d1c-bc12-324522f0ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.550962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33222e-e4ea-4d1c-bc12-324522f0ea6c None admin] PATH_INFO: `/v3/users/eb46a77364634d8aaf1c3e4dde6058dc` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.552286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33222e-e4ea-4d1c-bc12-324522f0ea6c None admin] RBAC: Authorizing `identity:get_user(user_id=eb46a77364634d8aaf1c3e4dde6058dc)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:24.555080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33222e-e4ea-4d1c-bc12-324522f0ea6c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:24.557219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 126/253] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/users/eb46a77364634d8aaf1c3e4dde6058dc => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:24.562658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc529f4-6432-47e8-a9e3-008867b25f5d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.658700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.718407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc529f4-6432-47e8-a9e3-008867b25f5d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.753234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.753795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.754079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.754356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.755505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:24.757513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:24.759501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 128/254] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:24.761878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af23735-3b5c-4651-9b5a-892ca8fd70eb None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.762164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af23735-3b5c-4651-9b5a-892ca8fd70eb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.762449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af23735-3b5c-4651-9b5a-892ca8fd70eb None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.763781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 127/255] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:24.768504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.770063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e7cd-ffdf-472b-b705-fab76914208b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.770352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e7cd-ffdf-472b-b705-fab76914208b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.773891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e7cd-ffdf-472b-b705-fab76914208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.806415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d152e7cd-ffdf-472b-b705-fab76914208b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:24.807629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d152e7cd-ffdf-472b-b705-fab76914208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:24.938174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 128/256] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:24.947587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f649d-efa6-4c54-b1d6-8816788ff615 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.983480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.995874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.996558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.996846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.997120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/eb46a77364634d8aaf1c3e4dde6058dc/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.005166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=365cf2fc54cd42cf94babc9a50eeab9f, user_id=eb46a77364634d8aaf1c3e4dde6058dc, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.007293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.035243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 129/257] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:24 2022] PUT /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/eb46a77364634d8aaf1c3e4dde6058dc/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:25.053757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e7cd-ffdf-472b-b705-fab76914208b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.103645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.174432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e7cd-ffdf-472b-b705-fab76914208b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.216054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.216715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.217001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.217277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.242207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:25.247512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:25.248412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:25.249192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 129/258] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:25.255775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.387997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27975e-7d30-4aec-b9af-4031a8356bf9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.423433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.424078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.424362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.424639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.425315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:25.425619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.426994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.435975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 130/259] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.441498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.495342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.565393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.578307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d2125-6c3b-4d40-aae1-5cd98df967b2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.591104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.650920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.651567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.651865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.652141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] PATH_INFO: `/v3/users/1e4e1148320d45bd97d7a140ffa9f27b` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.654697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] RBAC: Authorizing `identity:get_user(user_id=1e4e1148320d45bd97d7a140ffa9f27b)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.656180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.657774 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 130/260] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/users/1e4e1148320d45bd97d7a140ffa9f27b => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.663447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.695960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b68c-3e4a-49da-b886-f1a014c6c8c0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.760202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.760845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.761123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.761392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.778448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:25.784481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:25.785336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:25.786200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 131/261] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:25.792290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.861952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a430-b295-4c2a-b598-77ad238d1c44 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.909729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d29ca-ae85-45ba-aad5-db5406582ae3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.919840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.946432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.947055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.947335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.947656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.948384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:25.948701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.951853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.959571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 132/262] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:25.962133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.963001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.963476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.963970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.971021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.038997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.113135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be766d1-af6a-4ffa-8a08-38b061fe13f5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.127744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.133451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.149257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.149898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.150180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.150451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] PATH_INFO: `/v3/users/1e4e1148320d45bd97d7a140ffa9f27b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.151586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] RBAC: Authorizing `identity:get_user(user_id=1e4e1148320d45bd97d7a140ffa9f27b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.153052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.154625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 133/263] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/users/1e4e1148320d45bd97d7a140ffa9f27b => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:26.160358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.197110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.267528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3185f-c37e-4ad9-8d41-d8099ca5ca8a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.306812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febfe07-30c0-404e-88f5-f3293d825eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.307482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febfe07-30c0-404e-88f5-f3293d825eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.307988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febfe07-30c0-404e-88f5-f3293d825eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.308273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febfe07-30c0-404e-88f5-f3293d825eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.335545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 131/264] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:26.342419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.444026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febfe07-30c0-404e-88f5-f3293d825eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.445428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febfe07-30c0-404e-88f5-f3293d825eb8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.478995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.523976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.555466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17b8c-0ad9-4494-a188-a572078b385f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.591232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.591901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.592182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.592453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.593588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.595050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.597109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 132/265] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:26.605216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.643844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 134/266] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:26.659109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784eddc-796e-4b89-b964-420574eb1633 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.659426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784eddc-796e-4b89-b964-420574eb1633 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.659674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784eddc-796e-4b89-b964-420574eb1633 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.661152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 135/267] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:26.661723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784eddc-796e-4b89-b964-420574eb1633 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.717596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a7a2-4650-44bb-9dd1-af68522bb9e9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.776157 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.784250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a7e49-6cf2-4db9-987c-5f2e856cbe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.784967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7e49-6cf2-4db9-987c-5f2e856cbe3f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.785347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7e49-6cf2-4db9-987c-5f2e856cbe3f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.785624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a7e49-6cf2-4db9-987c-5f2e856cbe3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.786368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7e49-6cf2-4db9-987c-5f2e856cbe3f None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=1e4e1148320d45bd97d7a140ffa9f27b) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:26.786776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7e49-6cf2-4db9-987c-5f2e856cbe3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.789031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a7e49-6cf2-4db9-987c-5f2e856cbe3f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.796113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 133/268] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/role_assignments?user.id=1e4e1148320d45bd97d7a140ffa9f27b&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:26.797455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c3184-74f2-40be-a726-03034aaef80c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.797743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c3184-74f2-40be-a726-03034aaef80c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.798014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c3184-74f2-40be-a726-03034aaef80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.800498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784eddc-796e-4b89-b964-420574eb1633 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.819159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a53c3184-74f2-40be-a726-03034aaef80c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:26.820494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a53c3184-74f2-40be-a726-03034aaef80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:26.838947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5368b6-16c4-41f5-8a27-6fc0366b1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.839596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5368b6-16c4-41f5-8a27-6fc0366b1518 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.839902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5368b6-16c4-41f5-8a27-6fc0366b1518 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.840182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5368b6-16c4-41f5-8a27-6fc0366b1518 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.841314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5368b6-16c4-41f5-8a27-6fc0366b1518 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.842775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5368b6-16c4-41f5-8a27-6fc0366b1518 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.844621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 136/269] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:26.845542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2c58-8400-48cb-b260-85d04bdf9973 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.845825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2c58-8400-48cb-b260-85d04bdf9973 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.846098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e2c58-8400-48cb-b260-85d04bdf9973 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.847288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 137/270] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:26.852648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e2c58-8400-48cb-b260-85d04bdf9973 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.856736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.913982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 134/271] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:26.915822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503770-bceb-4513-a84e-9d60d66359e7 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.916304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503770-bceb-4513-a84e-9d60d66359e7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.916796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad503770-bceb-4513-a84e-9d60d66359e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.935783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ad503770-bceb-4513-a84e-9d60d66359e7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:26.937304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ad503770-bceb-4513-a84e-9d60d66359e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:26.966835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e2c58-8400-48cb-b260-85d04bdf9973 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.018841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3faa64-be6c-45c3-8e58-7d3f09feea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.020554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3faa64-be6c-45c3-8e58-7d3f09feea09 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.021731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3faa64-be6c-45c3-8e58-7d3f09feea09 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.023191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3faa64-be6c-45c3-8e58-7d3f09feea09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.024619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3faa64-be6c-45c3-8e58-7d3f09feea09 None admin] RBAC: Adding query filter params (role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=1e4e1148320d45bd97d7a140ffa9f27b) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:27.025321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3faa64-be6c-45c3-8e58-7d3f09feea09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.028071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3faa64-be6c-45c3-8e58-7d3f09feea09 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.029166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 135/272] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:27.036834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 138/273] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/role_assignments?user.id=1e4e1148320d45bd97d7a140ffa9f27b&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:27.122949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23122a-ef4f-4f7e-bea7-a2fff3b2638e None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.123614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23122a-ef4f-4f7e-bea7-a2fff3b2638e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.124117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23122a-ef4f-4f7e-bea7-a2fff3b2638e None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.126116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 136/274] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:27.131984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a967fc-df77-4d9e-8d73-bf93e2bc3eea None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.132584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a967fc-df77-4d9e-8d73-bf93e2bc3eea None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.133119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a967fc-df77-4d9e-8d73-bf93e2bc3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.154755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c9a967fc-df77-4d9e-8d73-bf93e2bc3eea None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:27.156407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c9a967fc-df77-4d9e-8d73-bf93e2bc3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:27.232770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:27.242869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 139/275] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:27.368947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23122a-ef4f-4f7e-bea7-a2fff3b2638e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.398441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a967fc-df77-4d9e-8d73-bf93e2bc3eea None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.435351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:27.496524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23122a-ef4f-4f7e-bea7-a2fff3b2638e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.545375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.546423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.546909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.547356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.547886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a967fc-df77-4d9e-8d73-bf93e2bc3eea None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.568102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:27.577265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:27.578197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:27.579001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 137/276] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:27.579641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.602089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.602840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.603121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.603387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.604784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.606346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.607951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 140/277] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:27.608887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.681475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:27.690095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b6342-bb46-4baa-8cbe-9d1b2029481c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.707610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:27.719723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3496e-90ce-400b-881f-991f6cd5bfde None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.726532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.727181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.727462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.727736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.738340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:27.743742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:27.744828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 138/278] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:27.748629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.762914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.763584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.763825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.764101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.764761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:27.765124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.766478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.775022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 141/279] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:27.777191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.852660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbf5b5-55ba-4439-afcb-699eee24be4a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.889847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.890465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.890747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.891023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.891667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.893171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.896337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58307-c491-4419-8218-ae8b00f4f806 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.923879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 139/280] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:27 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:27.924901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.926011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:27.935966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.936530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.936805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.937078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.938345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:27.938345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.939627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.950019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 142/281] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:27.956020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.978868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:28.072357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e994e8-660e-40bc-9057-ab134f9a4a14 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:28.099129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f270c6-dd4c-47a8-84f3-dec2cadde4af None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:28.118655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:28.119548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.120089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.120505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] PATH_INFO: `/v3/users/d1eb10e43efb404da5c69e87f8f22551` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:28.136808 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] RBAC: Authorizing `identity:get_user(user_id=d1eb10e43efb404da5c69e87f8f22551)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:28.138508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:28.140388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 140/282] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/users/d1eb10e43efb404da5c69e87f8f22551 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:28.145299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:28.146114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.146961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:28.148515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.148515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] PATH_INFO: `/v3/users/befa0c34d6f84e7b8d86f6b19bda4339` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:28.149896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] RBAC: Authorizing `identity:get_user(user_id=befa0c34d6f84e7b8d86f6b19bda4339)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:28.153163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:28.155882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 143/283] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/users/befa0c34d6f84e7b8d86f6b19bda4339 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:28.160507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:28.231148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:28.260776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:28.273800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca42c50-6c1f-4f84-98d2-e566988ce20a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:28.287492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a94b98-6e14-49a7-a277-36f09b085580 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:28.324567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:28.325833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.326758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.327505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:28.328524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, user.id=d1eb10e43efb404da5c69e87f8f22551, scope.system=all) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:28.329061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:28.330744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:28.331128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88650f5d-8634-4b96-b280-b6096427af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:28.331767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650f5d-8634-4b96-b280-b6096427af23 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.332074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650f5d-8634-4b96-b280-b6096427af23 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.332346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88650f5d-8634-4b96-b280-b6096427af23 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:28.333462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88650f5d-8634-4b96-b280-b6096427af23 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:28.335389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88650f5d-8634-4b96-b280-b6096427af23 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:28.337250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 144/284] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:28 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:28.338414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b02d7c-a5ef-4073-8a56-24f7ed320d25 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.338723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b02d7c-a5ef-4073-8a56-24f7ed320d25 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.338958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b02d7c-a5ef-4073-8a56-24f7ed320d25 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:28.339315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 141/285] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 17 16:02:28 2022] GET /identity/v3/role_assignments?user.id=d1eb10e43efb404da5c69e87f8f22551&scope.system=all&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:28.345136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 145/286] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:28.346479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:28.351128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744302b1-bbe4-493a-8ae4-5ec748a91578 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.351463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744302b1-bbe4-493a-8ae4-5ec748a91578 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.351676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744302b1-bbe4-493a-8ae4-5ec748a91578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:28.392229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-744302b1-bbe4-493a-8ae4-5ec748a91578 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:28.393461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-744302b1-bbe4-493a-8ae4-5ec748a91578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:28.482837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cc834-9452-4ebd-8ef7-c76dc1e0317e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:28.525776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 146/287] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:28.536904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:28.539005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.539491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.539993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/befa0c34d6f84e7b8d86f6b19bda4339/roles/5713af9e187348c7842eac08e8a75943` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:28.544394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=365cf2fc54cd42cf94babc9a50eeab9f, user_id=befa0c34d6f84e7b8d86f6b19bda4339, role_id=5713af9e187348c7842eac08e8a75943)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:28.546084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:28.564646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 142/288] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:28 2022] PUT /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/users/befa0c34d6f84e7b8d86f6b19bda4339/roles/5713af9e187348c7842eac08e8a75943 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:28.828794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744302b1-bbe4-493a-8ae4-5ec748a91578 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:28.892787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:28.946780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744302b1-bbe4-493a-8ae4-5ec748a91578 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:28.987681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:28.988350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:28.988625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:28.988897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:29.004644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:29.010906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:29.011780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:29.012603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 147/289] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:29.024056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:29.047348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:29.173771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee540-808d-4505-a7e7-8c85090513c6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:29.209493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:29.210262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:29.210542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:29.210812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:29.211543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] RBAC: Adding query filter params (name=member) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:29.211873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:29.213253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:29.222087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 143/290] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:29.228321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:29.371698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0318a-86a5-4beb-a4a4-aab9cd1858f1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:29.391297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:29.420586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:29.421235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:29.421519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:29.421799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] PATH_INFO: `/v3/users/eb46a77364634d8aaf1c3e4dde6058dc` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:29.432502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] RBAC: Authorizing `identity:get_user(user_id=eb46a77364634d8aaf1c3e4dde6058dc)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:29.433949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:29.435974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 148/291] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:29 2022] GET /identity/v3/users/eb46a77364634d8aaf1c3e4dde6058dc => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:29.441482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:29.551890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:29.580268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec8d1-6a4e-49b0-8153-a0aa51a2706f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:29.614277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:29.614890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:29.615704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:29.616006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:29.685205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:29.686614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:29.763052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:29.788392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 144/292] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:29.796890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:29.976032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc84bc-25ee-47ba-950f-a7663191a86c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:30.032080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcf0fc-026e-4908-be40-ab303157ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:30.032870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcf0fc-026e-4908-be40-ab303157ddef None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.033153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcf0fc-026e-4908-be40-ab303157ddef None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.033435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcf0fc-026e-4908-be40-ab303157ddef None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.040496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcf0fc-026e-4908-be40-ab303157ddef None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:30.041975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcf0fc-026e-4908-be40-ab303157ddef None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:30.044004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 149/293] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:29 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:30.049679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:30.190903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d161-9496-4234-8272-b74726c10f72 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:30.235449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce81756-f0de-478d-829e-91aeeed42b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:30.236012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce81756-f0de-478d-829e-91aeeed42b5f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.236298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce81756-f0de-478d-829e-91aeeed42b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.236569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce81756-f0de-478d-829e-91aeeed42b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.237309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce81756-f0de-478d-829e-91aeeed42b5f None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=eb46a77364634d8aaf1c3e4dde6058dc) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:30.237618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce81756-f0de-478d-829e-91aeeed42b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:30.239083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce81756-f0de-478d-829e-91aeeed42b5f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:30.245459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 145/294] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:30 2022] GET /identity/v3/role_assignments?user.id=eb46a77364634d8aaf1c3e4dde6058dc&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:30.368949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d447c3a-b65e-4d98-8e39-71c34921d8b3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.369267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d447c3a-b65e-4d98-8e39-71c34921d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.369499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d447c3a-b65e-4d98-8e39-71c34921d8b3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.370838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 150/295] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:30.376441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8120f1-904d-46ca-98ae-f2c0b87dd09a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.376723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8120f1-904d-46ca-98ae-f2c0b87dd09a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.376999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8120f1-904d-46ca-98ae-f2c0b87dd09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.401041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6e8120f1-904d-46ca-98ae-f2c0b87dd09a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.402278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6e8120f1-904d-46ca-98ae-f2c0b87dd09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.453480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:30.494542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 146/296] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:30.557961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7ecd-df33-46ad-9084-6a1f550abdd8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.558565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7ecd-df33-46ad-9084-6a1f550abdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.559037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7ecd-df33-46ad-9084-6a1f550abdd8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.560853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 151/297] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:30.566339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f810-541f-4cdb-abb4-dd9680ce3fb1 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.566799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f810-541f-4cdb-abb4-dd9680ce3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.566875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f810-541f-4cdb-abb4-dd9680ce3fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.588113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4822f810-541f-4cdb-abb4-dd9680ce3fb1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.589360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4822f810-541f-4cdb-abb4-dd9680ce3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.660920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 147/298] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:30.780977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3163-334e-4f3d-9a98-10332e08696b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.781576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3163-334e-4f3d-9a98-10332e08696b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.782051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d3163-334e-4f3d-9a98-10332e08696b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.783856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 152/299] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:30.789967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720710bd-e8c2-4d55-aeed-43d294658a80 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.790243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720710bd-e8c2-4d55-aeed-43d294658a80 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.792373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720710bd-e8c2-4d55-aeed-43d294658a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.815964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-720710bd-e8c2-4d55-aeed-43d294658a80 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.817168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-720710bd-e8c2-4d55-aeed-43d294658a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.825595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3163-334e-4f3d-9a98-10332e08696b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:30.901026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:30.920053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 148/300] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:30.959083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d3163-334e-4f3d-9a98-10332e08696b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:30.970829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720710bd-e8c2-4d55-aeed-43d294658a80 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:30.995989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:30.996685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.996968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.997250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.008691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:31.009909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:31.014671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:31.015564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:31.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 153/301] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:31.028800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.100297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720710bd-e8c2-4d55-aeed-43d294658a80 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.143341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.144020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.144303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.144578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.145697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.149381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.155939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 149/302] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:31.161858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.170304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031c044-27ff-4cbc-bd46-f21315db0a5c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.186626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.212503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744345a-55e6-466c-b774-eeb36aea8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.213126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744345a-55e6-466c-b774-eeb36aea8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.213406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744345a-55e6-466c-b774-eeb36aea8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.213679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744345a-55e6-466c-b774-eeb36aea8ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.214352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744345a-55e6-466c-b774-eeb36aea8ef1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:31.214655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744345a-55e6-466c-b774-eeb36aea8ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.216067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744345a-55e6-466c-b774-eeb36aea8ef1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.224159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 154/303] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.225992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32820-160d-46d7-a23f-2e5691626589 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.226276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32820-160d-46d7-a23f-2e5691626589 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.226556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32820-160d-46d7-a23f-2e5691626589 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.231844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 155/304] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:31.231844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32820-160d-46d7-a23f-2e5691626589 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.266577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.270703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd9b67-a2b5-4cf5-9128-efae984ae705 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.306735 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.307348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.307635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.307942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] PATH_INFO: `/v3/groups` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.308570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.310069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.326154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 150/305] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Aug 17 16:02:31 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:31.326960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.331713 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32820-160d-46d7-a23f-2e5691626589 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.383824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e8650-ba37-4ca3-be88-4de617536725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.384494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e8650-ba37-4ca3-be88-4de617536725 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.384776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e8650-ba37-4ca3-be88-4de617536725 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.385055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e8650-ba37-4ca3-be88-4de617536725 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.397551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e8650-ba37-4ca3-be88-4de617536725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-bf2e8650-ba37-4ca3-be88-4de617536725 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:31.403453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:31.404463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:31.405361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 156/306] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:31.406027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb359-2f0b-4de4-9d95-5f2badd24ef4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.406458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb359-2f0b-4de4-9d95-5f2badd24ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.406590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb359-2f0b-4de4-9d95-5f2badd24ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.426324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d50bb359-2f0b-4de4-9d95-5f2badd24ef4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:31.428211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d50bb359-2f0b-4de4-9d95-5f2badd24ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:31.452487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15f5cb-fa32-47eb-a24b-57327d4e6dfb None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.460771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.498110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.498760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.504657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.504657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] PATH_INFO: `/v3/users/b930fc4aea2340aeaeec69588d0a5d79` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.519247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 157/307] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:31.519525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] RBAC: Authorizing `identity:get_user(user_id=b930fc4aea2340aeaeec69588d0a5d79)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.519685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb359-2f0b-4de4-9d95-5f2badd24ef4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.521861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.522723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 151/308] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/users/b930fc4aea2340aeaeec69588d0a5d79 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.529254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.548385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.643129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb359-2f0b-4de4-9d95-5f2badd24ef4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.644371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca75a3-e8f3-4036-a028-f006de20b389 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.687308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.688167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.688666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.689049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.689272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.689528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.689839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.690251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.690547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] RBAC: Adding query filter params (role.id=5713af9e187348c7842eac08e8a75943, user.id=b930fc4aea2340aeaeec69588d0a5d79, scope.system=all) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:31.690956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.691375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:31.691845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.692731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.694169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.706150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 158/309] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.707962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 152/310] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/role_assignments?user.id=b930fc4aea2340aeaeec69588d0a5d79&scope.system=all&role.id=5713af9e187348c7842eac08e8a75943 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:31.717044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.747447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.815709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.832733 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38051c-741b-4d32-a8a6-182f1da65469 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.882267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.882920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.883204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.883480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] PATH_INFO: `/v3/users/d1eb10e43efb404da5c69e87f8f22551` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.884944 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] RBAC: Authorizing `identity:get_user(user_id=d1eb10e43efb404da5c69e87f8f22551)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.886992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.889189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 159/311] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/users/d1eb10e43efb404da5c69e87f8f22551 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.894547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.926393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.948672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e87bd-4eb0-4e86-8737-71609dedaeae None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.002011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.002671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.002955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.003232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.020299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:32.026866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:32.030295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:32.031345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:32.032278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:32.035833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 153/312] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:32.037494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbde0df-461d-4d1f-a71b-1fc7823aeba2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.042005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.088564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.089722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.090150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.090818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] PATH_INFO: `/v3/system/users/d1eb10e43efb404da5c69e87f8f22551/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.093246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d1eb10e43efb404da5c69e87f8f22551, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.095135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.107728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 160/313] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Aug 17 16:02:31 2022] PUT /identity/v3/system/users/d1eb10e43efb404da5c69e87f8f22551/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:32.158844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a5d67-a12c-4ba5-8ab7-ca342219697b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.200536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.201233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.201519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.201803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.202528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:32.202838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.204411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.221008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 154/314] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:32.222630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.332358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73473a6a-0d77-4c96-adc8-bda8fbd3cbc8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.368355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.368998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.369280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.369555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] PATH_INFO: `/v3/users/befa0c34d6f84e7b8d86f6b19bda4339` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.370696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=befa0c34d6f84e7b8d86f6b19bda4339)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.372155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.374052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 161/315] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/users/befa0c34d6f84e7b8d86f6b19bda4339 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.379629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.383344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.495719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6863106-063d-4567-a90f-426ae8fa2a7b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.531028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.531648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.531977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.532253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.604035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.605779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.607611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.715129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 155/316] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:32.721109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.750834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.843172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4a16-5527-4d33-ba65-1423959cc9c4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.879157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1b318-6a37-4ce2-bb45-c1fb0b67963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.880150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b318-6a37-4ce2-bb45-c1fb0b67963c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.880692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b318-6a37-4ce2-bb45-c1fb0b67963c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.881171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1b318-6a37-4ce2-bb45-c1fb0b67963c None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.882504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1b318-6a37-4ce2-bb45-c1fb0b67963c None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.884428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1b318-6a37-4ce2-bb45-c1fb0b67963c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.891163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 162/317] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.892834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:33.001849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf22186-5de5-4274-9553-bccc10abad99 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.003783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.040516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbef32f-a887-4b88-8a40-f89a504eab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.041138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbef32f-a887-4b88-8a40-f89a504eab17 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.041422 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbef32f-a887-4b88-8a40-f89a504eab17 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.041701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbef32f-a887-4b88-8a40-f89a504eab17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.042437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbef32f-a887-4b88-8a40-f89a504eab17 None admin] RBAC: Adding query filter params (role.id=5713af9e187348c7842eac08e8a75943, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f, user.id=befa0c34d6f84e7b8d86f6b19bda4339) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:33.042748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbef32f-a887-4b88-8a40-f89a504eab17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.044249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbef32f-a887-4b88-8a40-f89a504eab17 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.054523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 156/318] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/role_assignments?user.id=befa0c34d6f84e7b8d86f6b19bda4339&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=5713af9e187348c7842eac08e8a75943 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:33.351565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82bfb-ebbf-4193-81c5-876c68b63a0f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.352083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82bfb-ebbf-4193-81c5-876c68b63a0f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.352083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82bfb-ebbf-4193-81c5-876c68b63a0f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.353565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 163/319] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:33.358720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0c854-210a-415a-adb5-1184323de8a3 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.359010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0c854-210a-415a-adb5-1184323de8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.359286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0c854-210a-415a-adb5-1184323de8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.377637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9fe0c854-210a-415a-adb5-1184323de8a3 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:33.378841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9fe0c854-210a-415a-adb5-1184323de8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:33.453126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 157/320] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:33.716966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82bfb-ebbf-4193-81c5-876c68b63a0f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:33.751765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0eb4-9bc8-4540-a6e5-c8433fa477d0 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.752401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0eb4-9bc8-4540-a6e5-c8433fa477d0 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.752401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0eb4-9bc8-4540-a6e5-c8433fa477d0 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.753789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 158/321] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:33.759390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceaf67-be5f-4a2b-874d-71bd15b90eac None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.759676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceaf67-be5f-4a2b-874d-71bd15b90eac None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.759992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebceaf67-be5f-4a2b-874d-71bd15b90eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.780693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ebceaf67-be5f-4a2b-874d-71bd15b90eac None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:33.782388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ebceaf67-be5f-4a2b-874d-71bd15b90eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:33.820564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.828749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82bfb-ebbf-4193-81c5-876c68b63a0f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.865877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 159/322] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:33.866794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954ed13-1b21-4481-9e5c-4d8b9b1fba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.867398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ed13-1b21-4481-9e5c-4d8b9b1fba64 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.867677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ed13-1b21-4481-9e5c-4d8b9b1fba64 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.867983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ed13-1b21-4481-9e5c-4d8b9b1fba64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.869111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954ed13-1b21-4481-9e5c-4d8b9b1fba64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.870550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954ed13-1b21-4481-9e5c-4d8b9b1fba64 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.872129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 164/323] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:33.877547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceaf67-be5f-4a2b-874d-71bd15b90eac None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:33.905221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.980287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebceaf67-be5f-4a2b-874d-71bd15b90eac None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.014525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784703-74c9-4931-97de-d490eef692e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.015146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784703-74c9-4931-97de-d490eef692e3 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.015426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784703-74c9-4931-97de-d490eef692e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.015697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784703-74c9-4931-97de-d490eef692e3 None admin] PATH_INFO: `/v3/groups` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.016357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18784703-74c9-4931-97de-d490eef692e3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:34.017817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18784703-74c9-4931-97de-d490eef692e3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:34.039832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 160/324] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Aug 17 16:02:33 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:02:34.079901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639ddf9-be53-47ed-be6c-c6a5a3ccd1cc None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.080237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639ddf9-be53-47ed-be6c-c6a5a3ccd1cc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.080522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639ddf9-be53-47ed-be6c-c6a5a3ccd1cc None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.081943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 165/325] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:34.088028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa18b8-4b4b-487a-91c3-9d6defd9a037 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.088357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa18b8-4b4b-487a-91c3-9d6defd9a037 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.088593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa18b8-4b4b-487a-91c3-9d6defd9a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.108524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-3cfa18b8-4b4b-487a-91c3-9d6defd9a037 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:34.109814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3cfa18b8-4b4b-487a-91c3-9d6defd9a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:34.137734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639ddf9-be53-47ed-be6c-c6a5a3ccd1cc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.186800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 161/326] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:34.247732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639ddf9-be53-47ed-be6c-c6a5a3ccd1cc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.284270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.284930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.285187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.285456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.298243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:34.304126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:34.305003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:34.305796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:34.307916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 166/327] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:34.311464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa18b8-4b4b-487a-91c3-9d6defd9a037 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.330559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:34.423448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa18b8-4b4b-487a-91c3-9d6defd9a037 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.460509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.461233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.461550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.461858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.462565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:34.462901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:34.463254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.464590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:34.476558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 162/328] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:34.482464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.505218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:34.584249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:34.605293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ec4a-64ed-4613-8946-5d03d5d0c836 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.608495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cddafd-f6e8-4feb-99e8-20523df8c99e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.645031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.645668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.645951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.646900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.648221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.649029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.649480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.649944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] PATH_INFO: `/v3/users/b930fc4aea2340aeaeec69588d0a5d79` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.651299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] RBAC: Authorizing `identity:get_user(user_id=b930fc4aea2340aeaeec69588d0a5d79)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:34.652957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:34.657962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:34.658189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 163/329] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:34 2022] GET /identity/v3/users/b930fc4aea2340aeaeec69588d0a5d79 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:34.660940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:34.663716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:34.664786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:34.665886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 167/330] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:34.670489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.762356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:34.784609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974941b-2fa2-4c1b-bc85-213a0f395283 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.792061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e3227-18ed-4c15-af06-8b68a6c22b77 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.822080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.822946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.823397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.823960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.824883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:34.825332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:34.826866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:34.835668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.836880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.836880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.837056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] PATH_INFO: `/v3/system/users/b930fc4aea2340aeaeec69588d0a5d79/roles/5713af9e187348c7842eac08e8a75943` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.838661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b930fc4aea2340aeaeec69588d0a5d79, role_id=5713af9e187348c7842eac08e8a75943)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:34.838831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 168/331] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:34.843294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:34.845001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.855230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 164/332] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Aug 17 16:02:34 2022] PUT /identity/v3/system/users/b930fc4aea2340aeaeec69588d0a5d79/roles/5713af9e187348c7842eac08e8a75943 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:34.961760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61802642-f9c7-45f8-a1e4-7634c422a0cb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:35.000399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51edd5-eb2c-49ce-bb98-f2d29f2564fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:35.001424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51edd5-eb2c-49ce-bb98-f2d29f2564fb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:35.001905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51edd5-eb2c-49ce-bb98-f2d29f2564fb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:35.002376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51edd5-eb2c-49ce-bb98-f2d29f2564fb None admin] PATH_INFO: `/v3/users/d1eb10e43efb404da5c69e87f8f22551` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:35.003845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51edd5-eb2c-49ce-bb98-f2d29f2564fb None admin] RBAC: Authorizing `identity:get_user(user_id=d1eb10e43efb404da5c69e87f8f22551)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:35.006186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51edd5-eb2c-49ce-bb98-f2d29f2564fb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:35.008307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 169/333] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:34 2022] GET /identity/v3/users/d1eb10e43efb404da5c69e87f8f22551 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:35.014523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:35.034742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:35.144771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ca431-3300-4528-bb94-7e890c9a6e57 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:35.187173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab52746-3eda-4d86-94a8-c61b50ad6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:35.187783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab52746-3eda-4d86-94a8-c61b50ad6870 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:35.188090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab52746-3eda-4d86-94a8-c61b50ad6870 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:35.188366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab52746-3eda-4d86-94a8-c61b50ad6870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:35.189128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab52746-3eda-4d86-94a8-c61b50ad6870 None admin] RBAC: Adding query filter params (role.id=c8ae3e3da796422fab32e4d6a86a89d5, user.id=d1eb10e43efb404da5c69e87f8f22551, scope.system=all) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:35.189401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab52746-3eda-4d86-94a8-c61b50ad6870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:35.190844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab52746-3eda-4d86-94a8-c61b50ad6870 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:35.203535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 165/334] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 17 16:02:35 2022] GET /identity/v3/role_assignments?user.id=d1eb10e43efb404da5c69e87f8f22551&scope.system=all&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:36.299507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f72a-8a7e-4f5f-a2d2-aac59175af97 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.300203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f72a-8a7e-4f5f-a2d2-aac59175af97 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.300203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f72a-8a7e-4f5f-a2d2-aac59175af97 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.301647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 170/335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:36.310294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690009e-b38c-4588-b065-a57bc2049a84 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.310763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690009e-b38c-4588-b065-a57bc2049a84 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.310859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690009e-b38c-4588-b065-a57bc2049a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.333263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9690009e-b38c-4588-b065-a57bc2049a84 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:36.334738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9690009e-b38c-4588-b065-a57bc2049a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:36.428826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:36.435172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 166/336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:36.514762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4df67-8aed-4efd-a620-91fdbfe6630b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.515111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4df67-8aed-4efd-a620-91fdbfe6630b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.515321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4df67-8aed-4efd-a620-91fdbfe6630b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.516960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 171/337] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:36.522816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8ebf-942f-4611-9997-75987d2c9ccd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.523363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8ebf-942f-4611-9997-75987d2c9ccd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.523877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8ebf-942f-4611-9997-75987d2c9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.548389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-446f8ebf-942f-4611-9997-75987d2c9ccd None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:36.549949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-446f8ebf-942f-4611-9997-75987d2c9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:36.639911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 167/338] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:36.796677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4df67-8aed-4efd-a620-91fdbfe6630b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:36.812779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:36.924428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4df67-8aed-4efd-a620-91fdbfe6630b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:36.960267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:36.960911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.961189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.961462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.977359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:36.986706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:36.987594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:36.988420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 172/339] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:36.994497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8ebf-942f-4611-9997-75987d2c9ccd None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.098975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.111498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8ebf-942f-4611-9997-75987d2c9ccd None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.148587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.153210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.153853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.154142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.154456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.155094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] RBAC: Adding query filter params (name=member) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:37.155402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:37.156858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:37.166936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 168/340] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:37.176923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.260211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.287332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49814a-647c-40ec-a53c-109e5bf9b217 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.320718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386e9f4-5a34-4a58-8546-ba450e3b922e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.361119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.361778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.362058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.362332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.372818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e886798-9631-437c-8f93-91b666db5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.373503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e886798-9631-437c-8f93-91b666db5865 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.373790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e886798-9631-437c-8f93-91b666db5865 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.374064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e886798-9631-437c-8f93-91b666db5865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.385710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:37.390530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:37.391373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:37.392244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:37.396304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 173/341] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:37.408830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.464415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e886798-9631-437c-8f93-91b666db5865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:37.466316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e886798-9631-437c-8f93-91b666db5865 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:37.476526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.618773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f969f0a-b359-40fb-905e-a8f2339f0fd5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.628339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 169/342] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:37.629783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babfa6e-c94a-4a64-ac46-434ecb3dbb7e None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.630214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babfa6e-c94a-4a64-ac46-434ecb3dbb7e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.633133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babfa6e-c94a-4a64-ac46-434ecb3dbb7e None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.634822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 170/343] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:37.635759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babfa6e-c94a-4a64-ac46-434ecb3dbb7e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.680128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.690452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72631603-13b1-49be-a83e-c22f30fc3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.691417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631603-13b1-49be-a83e-c22f30fc3a2c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.691935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631603-13b1-49be-a83e-c22f30fc3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.692403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631603-13b1-49be-a83e-c22f30fc3a2c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.693977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72631603-13b1-49be-a83e-c22f30fc3a2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:37.695257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72631603-13b1-49be-a83e-c22f30fc3a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:37.696870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72631603-13b1-49be-a83e-c22f30fc3a2c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:37.715414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 174/344] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:37.718565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a695f-e280-4a58-a787-cf2662b38119 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.719220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a695f-e280-4a58-a787-cf2662b38119 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.720911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a695f-e280-4a58-a787-cf2662b38119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.756681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1b9a695f-e280-4a58-a787-cf2662b38119 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:37.758302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1b9a695f-e280-4a58-a787-cf2662b38119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:37.817587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.845300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 175/345] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:37.846155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babfa6e-c94a-4a64-ac46-434ecb3dbb7e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.847826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a695f-e280-4a58-a787-cf2662b38119 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.914924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.915516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.915832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.916105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.917690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:37.919507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:37.921553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 171/346] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:37.927693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.021380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a695f-e280-4a58-a787-cf2662b38119 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.062793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.086551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a6ca1-d124-4e59-9ec4-fdb0fc36b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.087560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a6ca1-d124-4e59-9ec4-fdb0fc36b024 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.089315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a6ca1-d124-4e59-9ec4-fdb0fc36b024 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.089794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a6ca1-d124-4e59-9ec4-fdb0fc36b024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.124710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa18ee-d8f7-4b71-b421-926e30c178ae None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.200412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c8687-4113-405d-9ff2-c507bba54170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.200412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c8687-4113-405d-9ff2-c507bba54170 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.200646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c8687-4113-405d-9ff2-c507bba54170 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.200888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c8687-4113-405d-9ff2-c507bba54170 None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.209617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c8687-4113-405d-9ff2-c507bba54170 None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.212130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c8687-4113-405d-9ff2-c507bba54170 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.214128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 172/347] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:38.215572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919ecb9-5c93-400f-b4cd-27f911c15d9f None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.215872 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919ecb9-5c93-400f-b4cd-27f911c15d9f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.216148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919ecb9-5c93-400f-b4cd-27f911c15d9f None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.219239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 173/348] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:38.219239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919ecb9-5c93-400f-b4cd-27f911c15d9f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.221719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a6ca1-d124-4e59-9ec4-fdb0fc36b024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.225299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a6ca1-d124-4e59-9ec4-fdb0fc36b024 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.252619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.358310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919ecb9-5c93-400f-b4cd-27f911c15d9f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.362285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 176/349] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:38.363515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0ceb-9a02-4d59-9d8a-e81d2c515129 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.363845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0ceb-9a02-4d59-9d8a-e81d2c515129 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.364101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d0ceb-9a02-4d59-9d8a-e81d2c515129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.385636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-692d0ceb-9a02-4d59-9d8a-e81d2c515129 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:38.385636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-692d0ceb-9a02-4d59-9d8a-e81d2c515129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:38.399273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.400400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.400882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.401421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.404878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.414577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:38.420340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:38.421227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:38.422065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:38.424698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 174/350] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:38.425708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.472384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 177/351] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:38.473070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0ceb-9a02-4d59-9d8a-e81d2c515129 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.513263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.545149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5c645-27d6-4496-9fa0-a91aac2bc426 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.589477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d0ceb-9a02-4d59-9d8a-e81d2c515129 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.606153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.606778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.607147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.607387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.608164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=258fc26104b542a6b4798666f4dd698d) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:38.608475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.609963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.621969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 175/352] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.622822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.628277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174d90f-1a2d-405f-9be9-cfcaf1f9edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.629177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174d90f-1a2d-405f-9be9-cfcaf1f9edb8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.629622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174d90f-1a2d-405f-9be9-cfcaf1f9edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.630031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174d90f-1a2d-405f-9be9-cfcaf1f9edb8 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.631899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174d90f-1a2d-405f-9be9-cfcaf1f9edb8 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.633615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174d90f-1a2d-405f-9be9-cfcaf1f9edb8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.635920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 178/353] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.637760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25d64-db28-4818-8cea-a4c9f3928edd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.638182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25d64-db28-4818-8cea-a4c9f3928edd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.638590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25d64-db28-4818-8cea-a4c9f3928edd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.640359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 179/354] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:38.642845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25d64-db28-4818-8cea-a4c9f3928edd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.676215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.770425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25d64-db28-4818-8cea-a4c9f3928edd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.799285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376f402-d504-4699-951b-bc0aed1c71da None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.816655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb23fe2-5e83-48c4-a149-8fe5e29271fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.817588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb23fe2-5e83-48c4-a149-8fe5e29271fd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.818684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb23fe2-5e83-48c4-a149-8fe5e29271fd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.819443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb23fe2-5e83-48c4-a149-8fe5e29271fd None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.820908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb23fe2-5e83-48c4-a149-8fe5e29271fd None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.822657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb23fe2-5e83-48c4-a149-8fe5e29271fd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.837440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 180/355] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.838806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264080dd-15c7-4b3c-94b0-47e15949e181 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.839095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264080dd-15c7-4b3c-94b0-47e15949e181 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.839371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264080dd-15c7-4b3c-94b0-47e15949e181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.868485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-264080dd-15c7-4b3c-94b0-47e15949e181 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:38.869697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-264080dd-15c7-4b3c-94b0-47e15949e181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:38.871594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.872472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.872937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.873344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.874153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] RBAC: Adding query filter params (name=member) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:38.874610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.877380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.888208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 176/356] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.890423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.903532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.965233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 181/357] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:38.966161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264080dd-15c7-4b3c-94b0-47e15949e181 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.990950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.012812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1652-6b70-4b74-9ba6-ca7d7c37fb34 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.050522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.051489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.052022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.052544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.053480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=258fc26104b542a6b4798666f4dd698d) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:39.053992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.055763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.062234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 177/358] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.063314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.083433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264080dd-15c7-4b3c-94b0-47e15949e181 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.123990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.124649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.124985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.125254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.137922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:39.143837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:39.144798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:39.145587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 182/359] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:39.152091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.152463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.185640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659e72d-8c2e-4c2e-b95b-b305176e45eb None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.226875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db11f2-9732-4976-ae11-8e89d03b9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.228586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db11f2-9732-4976-ae11-8e89d03b9e5b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.229590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db11f2-9732-4976-ae11-8e89d03b9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.230076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db11f2-9732-4976-ae11-8e89d03b9e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.252272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.279627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bc13b-5138-421b-b763-0ad83febd6dd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.341023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db11f2-9732-4976-ae11-8e89d03b9e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.342707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db11f2-9732-4976-ae11-8e89d03b9e5b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.368818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e34e0-3586-47ab-aa0d-4bbbba01e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.369467 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e34e0-3586-47ab-aa0d-4bbbba01e2cb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.369711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e34e0-3586-47ab-aa0d-4bbbba01e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.369973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e34e0-3586-47ab-aa0d-4bbbba01e2cb None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.370651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e34e0-3586-47ab-aa0d-4bbbba01e2cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:39.370950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e34e0-3586-47ab-aa0d-4bbbba01e2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.372353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e34e0-3586-47ab-aa0d-4bbbba01e2cb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.388344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 183/360] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:39.389626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dbf0-7ee3-412c-93d1-a4833526c0f9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.389913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dbf0-7ee3-412c-93d1-a4833526c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.390183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1dbf0-7ee3-412c-93d1-a4833526c0f9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.391633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 184/361] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:39.398055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1dbf0-7ee3-412c-93d1-a4833526c0f9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.485261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.522571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1dbf0-7ee3-412c-93d1-a4833526c0f9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.529969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 178/362] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:39.531377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a05491-3b3f-49f2-b4a9-03389bf1f0f5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.531671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a05491-3b3f-49f2-b4a9-03389bf1f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.531977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a05491-3b3f-49f2-b4a9-03389bf1f0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.551988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-10a05491-3b3f-49f2-b4a9-03389bf1f0f5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:39.553375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-10a05491-3b3f-49f2-b4a9-03389bf1f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:39.563764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.564445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.565155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.565433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] PATH_INFO: `/v3/users/b930fc4aea2340aeaeec69588d0a5d79` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.566909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] RBAC: Authorizing `identity:get_user(user_id=b930fc4aea2340aeaeec69588d0a5d79)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.568783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.570658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 185/363] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/users/b930fc4aea2340aeaeec69588d0a5d79 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.571592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.600302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.639933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 179/364] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:39.640996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a05491-3b3f-49f2-b4a9-03389bf1f0f5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.694214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4750f19-77fe-49f3-b729-dd629cb1af35 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.757119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.758144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.758633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.759108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.783678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:39.795040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:39.796015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:39.797242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:39.802931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 186/365] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:39.804173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.822253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a05491-3b3f-49f2-b4a9-03389bf1f0f5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.828603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.940573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8d3a1-b3b2-4795-b7bb-2b84550f21d9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.948640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.968519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.969420 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.969844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.970284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.976512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.978209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.980357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 180/366] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.980921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.981578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.981683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.981919 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.982197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.983305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] RBAC: Adding query filter params (role.id=5713af9e187348c7842eac08e8a75943, user.id=b930fc4aea2340aeaeec69588d0a5d79, scope.system=all) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:39.983936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.991827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.003889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 187/367] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/role_assignments?user.id=b930fc4aea2340aeaeec69588d0a5d79&scope.system=all&role.id=5713af9e187348c7842eac08e8a75943 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.004773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.144970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd14219-04bc-4b14-af07-fbf5479f2e9e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.149731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d758a-6ae2-4fb2-9163-38ccf2531c6d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.187036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.197478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.197891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.198180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.198472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.200298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.202560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.205295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 188/368] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.206146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.218518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.219133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.219411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.219681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.220388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:40.220692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.222064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.233114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 181/369] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.233806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.277417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.336961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841c780-d8a2-42b4-8f7c-c69c5b034440 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.372935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85886471-b071-4ada-8a91-df0aff022275 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.394278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.394921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.395203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.395472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.409007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:40.416835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.417450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:40.417554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:40.418385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:40.419199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:40.419820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.419820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.419957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 189/370] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:40.420030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:40.420030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.420157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.421688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.430250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 182/371] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.431156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.520255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.557461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.564373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521e456-df55-4fde-8aaf-145311bdba16 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.606356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.606997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.607281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.607560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.608452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:40.608760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.610349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.618123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51ad13-6c23-473e-aae2-8b2b150d1e9a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.621714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 183/372] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.627775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.695833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.696614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.696899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.697177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.790385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.792319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.869777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0b583-5b94-4918-b004-107467d2a61c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.876196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.913830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 190/373] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:40.919880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.973067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.973702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.974010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.974363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.016958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.037224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0eac09-6837-4b2b-9ee8-7897c7cdb122 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.077702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.078264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.078549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.078825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.079942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.080054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.081405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.081512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.083637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 191/374] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.089581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.133954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.204724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 184/375] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:41.210841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.260854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcde2d-fa50-4058-ba95-15218fe72edb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.276255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.305864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece566a-3380-47b6-81da-fa7e5abd66ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.306502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece566a-3380-47b6-81da-fa7e5abd66ef None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.306786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece566a-3380-47b6-81da-fa7e5abd66ef None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.307062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece566a-3380-47b6-81da-fa7e5abd66ef None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.308413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece566a-3380-47b6-81da-fa7e5abd66ef None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.309853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece566a-3380-47b6-81da-fa7e5abd66ef None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.312890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 192/376] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.314163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462944-2552-4ab8-a358-805c5f8475e3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.314456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462944-2552-4ab8-a358-805c5f8475e3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.314829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462944-2552-4ab8-a358-805c5f8475e3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.316458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 193/377] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:41.317190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462944-2552-4ab8-a358-805c5f8475e3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.324813 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e212df9-ffbd-4867-90b0-e350c561d3b4 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.362802 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0a422-9b46-4308-a403-68982752563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.363450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0a422-9b46-4308-a403-68982752563c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.363776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0a422-9b46-4308-a403-68982752563c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.364077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0a422-9b46-4308-a403-68982752563c None admin] PATH_INFO: `/v3/projects/8e2e0137191a4168b0b70f0ebaa36507` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.365845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0a422-9b46-4308-a403-68982752563c None admin] RBAC: Authorizing `identity:get_project(project_id=8e2e0137191a4168b0b70f0ebaa36507)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.367537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0a422-9b46-4308-a403-68982752563c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.369591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 185/378] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/projects/8e2e0137191a4168b0b70f0ebaa36507 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:41.370864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc97c60-40f6-49b7-ad5d-783ccd93fe80 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.371195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc97c60-40f6-49b7-ad5d-783ccd93fe80 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.371557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc97c60-40f6-49b7-ad5d-783ccd93fe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.391794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7bc97c60-40f6-49b7-ad5d-783ccd93fe80 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:41.393137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7bc97c60-40f6-49b7-ad5d-783ccd93fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:41.425309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.439303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462944-2552-4ab8-a358-805c5f8475e3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.486929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 186/379] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:41.490793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc97c60-40f6-49b7-ad5d-783ccd93fe80 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.497196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0caae-f9a1-49b6-87a4-0b5543ad46fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.499706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0caae-f9a1-49b6-87a4-0b5543ad46fb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.500271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0caae-f9a1-49b6-87a4-0b5543ad46fb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.500685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0caae-f9a1-49b6-87a4-0b5543ad46fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.501759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0caae-f9a1-49b6-87a4-0b5543ad46fb None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:41.503379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0caae-f9a1-49b6-87a4-0b5543ad46fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.505203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0caae-f9a1-49b6-87a4-0b5543ad46fb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.512112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 194/380] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.557072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.607958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc97c60-40f6-49b7-ad5d-783ccd93fe80 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.646990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.647585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.647885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.648161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] PATH_INFO: `/v3/groups/49db2cfadb2445c18088af0516aab5c2` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.654309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] RBAC: Authorizing `identity:get_group(group_id=49db2cfadb2445c18088af0516aab5c2)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.655505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795fe7b-b05a-48ad-8dbb-edf148e676ed None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.655836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.656245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795fe7b-b05a-48ad-8dbb-edf148e676ed None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.656720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795fe7b-b05a-48ad-8dbb-edf148e676ed None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.657715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 187/381] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/groups/49db2cfadb2445c18088af0516aab5c2 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.660239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 195/382] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:41.664170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.665810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e4c-05e0-4449-a1b0-0f4d42d3bed7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.666312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e4c-05e0-4449-a1b0-0f4d42d3bed7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.666927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66e4c-05e0-4449-a1b0-0f4d42d3bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.694669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f8f66e4c-05e0-4449-a1b0-0f4d42d3bed7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:41.696382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f8f66e4c-05e0-4449-a1b0-0f4d42d3bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:41.775829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00841105-7e2b-4121-a17c-891980ef3b34 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.800161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.817801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.819075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.819369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.819653 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.820439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] RBAC: Adding query filter params (group.id=49db2cfadb2445c18088af0516aab5c2, role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=8e2e0137191a4168b0b70f0ebaa36507) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:41.820736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.822203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.835009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 188/383] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/role_assignments?group.id=49db2cfadb2445c18088af0516aab5c2&scope.project.id=8e2e0137191a4168b0b70f0ebaa36507&role.id=b73be4c438e74c73b714b299c1412271 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.845404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 196/384] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:41.885963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.007246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518445a4-75ca-4ecd-917f-3ff757a9e7ca None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.056455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.057104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.057384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.057659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.068656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:42.073484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:42.074340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:42.075127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 189/385] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:42.081164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66e4c-05e0-4449-a1b0-0f4d42d3bed7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.204143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.220563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66e4c-05e0-4449-a1b0-0f4d42d3bed7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.260985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.261539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.261818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.262093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.262778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:42.263086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.264542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.274337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 197/386] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:42.279437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.341952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.359048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.450888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112593e-1623-4473-8d42-79cdadf4c777 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.475787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e2a87-540e-40c1-8f7d-00ecb549106b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.489123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.490486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.491117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.491410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.504158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:42.511162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:42.512135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:42.512967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:42.515414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 198/387] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:42.519071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.531390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.608542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.609226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.609472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.609746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.611205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.612713 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.615150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 190/388] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:42.620692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.634524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc358f-6c6b-46db-9f7b-c5c08c58b874 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.673296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.674303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.674586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.674864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.675539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:42.675871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.678247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.692048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 199/389] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:42.693487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.778605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.816524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e743a25-a6ee-439b-ab8c-2008cfca0f05 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.841190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0088-c76b-473d-abc8-c2be51e5f13a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.858049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.858759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.859172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.859749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.859990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.866129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.867605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.870137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 200/390] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:42.879578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.909605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.912507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.912507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.912884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.915992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.918817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.924179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 191/391] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:42.930325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:43.053510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7a964-85e3-4ffe-b06d-fa74c42c0f13 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:43.084569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778c57b-7acf-4fbb-b086-83c950a1d306 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:43.094856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:43.095511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.095834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.096101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.097247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:43.098802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:43.106168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 201/392] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:43.107487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:43.117206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:43.153107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b16be4-1120-4c7c-b7c7-485d84bba4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:43.153802 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16be4-1120-4c7c-b7c7-485d84bba4a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.154082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16be4-1120-4c7c-b7c7-485d84bba4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.154357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b16be4-1120-4c7c-b7c7-485d84bba4a0 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d/groups/a5e255a89e514a4db5fa84057b89172a/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.164606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16be4-1120-4c7c-b7c7-485d84bba4a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=258fc26104b542a6b4798666f4dd698d, group_id=a5e255a89e514a4db5fa84057b89172a, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:43.166081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b16be4-1120-4c7c-b7c7-485d84bba4a0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:43.190296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 192/393] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 17 16:02:42 2022] PUT /identity/v3/projects/258fc26104b542a6b4798666f4dd698d/groups/a5e255a89e514a4db5fa84057b89172a/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:43.225234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9efc2-a8ad-4407-bcb2-1e8a3865c909 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:43.265576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde384-1aa2-415f-babd-d6a59d4f99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:43.266279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde384-1aa2-415f-babd-d6a59d4f99a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.266567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde384-1aa2-415f-babd-d6a59d4f99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.266909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde384-1aa2-415f-babd-d6a59d4f99a6 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d/groups/a5e255a89e514a4db5fa84057b89172a/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.269320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cde384-1aa2-415f-babd-d6a59d4f99a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=258fc26104b542a6b4798666f4dd698d, group_id=a5e255a89e514a4db5fa84057b89172a, role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:43.271209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cde384-1aa2-415f-babd-d6a59d4f99a6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:43.289466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 202/394] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 17 16:02:43 2022] PUT /identity/v3/projects/258fc26104b542a6b4798666f4dd698d/groups/a5e255a89e514a4db5fa84057b89172a/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:43.582570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffa00-dd24-4ece-8bd5-c7af44898f31 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.582942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffa00-dd24-4ece-8bd5-c7af44898f31 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.583177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ffa00-dd24-4ece-8bd5-c7af44898f31 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.584725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 193/395] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:43.590084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632317-3edd-42a2-955f-3e36fa9d1d7c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.590546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632317-3edd-42a2-955f-3e36fa9d1d7c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.590636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5632317-3edd-42a2-955f-3e36fa9d1d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.613221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d5632317-3edd-42a2-955f-3e36fa9d1d7c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:43.614450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d5632317-3edd-42a2-955f-3e36fa9d1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:43.681413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:43.694114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 203/396] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:43.749240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcf80-2dd3-48de-bd9c-0292d6c03a18 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.749766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcf80-2dd3-48de-bd9c-0292d6c03a18 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.749766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcf80-2dd3-48de-bd9c-0292d6c03a18 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.751380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 194/397] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:43.761221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877b7e8-85aa-444d-824b-9b91b0d68e6e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.761514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877b7e8-85aa-444d-824b-9b91b0d68e6e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.761788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877b7e8-85aa-444d-824b-9b91b0d68e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.785085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6877b7e8-85aa-444d-824b-9b91b0d68e6e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:43.786277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6877b7e8-85aa-444d-824b-9b91b0d68e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:43.870975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 204/398] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:44.215995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bcf80-2dd3-48de-bd9c-0292d6c03a18 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.267016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:44.341428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bcf80-2dd3-48de-bd9c-0292d6c03a18 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.383865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.384501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.384784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.385060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.401022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:44.405841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:44.406721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:44.407595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 195/399] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:44.415062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877b7e8-85aa-444d-824b-9b91b0d68e6e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.437024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.552634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbf8b-273a-4d9f-acbe-c7acc084d27b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.564184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:44.594265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dfa63-ce79-4672-b7f8-61a66439d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.594909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfa63-ce79-4672-b7f8-61a66439d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.595192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfa63-ce79-4672-b7f8-61a66439d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.595467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfa63-ce79-4672-b7f8-61a66439d0c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.602461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877b7e8-85aa-444d-824b-9b91b0d68e6e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.607217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dfa63-ce79-4672-b7f8-61a66439d0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-014dfa63-ce79-4672-b7f8-61a66439d0c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:44.612693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:44.613598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:44.614383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 196/400] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:44.617068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0441-37ce-4af2-aa21-54e16e4bc92e None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.617068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0441-37ce-4af2-aa21-54e16e4bc92e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.617068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa0441-37ce-4af2-aa21-54e16e4bc92e None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.619204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 197/401] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:44.623912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa0441-37ce-4af2-aa21-54e16e4bc92e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.632866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:44.644010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2a53e-c429-4fc1-840d-1daa6b414b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.644563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a53e-c429-4fc1-840d-1daa6b414b10 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.644844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a53e-c429-4fc1-840d-1daa6b414b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.645122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a53e-c429-4fc1-840d-1daa6b414b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.646399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2a53e-c429-4fc1-840d-1daa6b414b10 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:44.646709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2a53e-c429-4fc1-840d-1daa6b414b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:44.648604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2a53e-c429-4fc1-840d-1daa6b414b10 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:44.665577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 205/402] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:44.666880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c555-cc03-4e5e-a2c4-1568f1b70765 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.667165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c555-cc03-4e5e-a2c4-1568f1b70765 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.667441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c555-cc03-4e5e-a2c4-1568f1b70765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.688294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-db50c555-cc03-4e5e-a2c4-1568f1b70765 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:44.689503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-db50c555-cc03-4e5e-a2c4-1568f1b70765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:44.780612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa0441-37ce-4af2-aa21-54e16e4bc92e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.787504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 206/403] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:44.788480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50c555-cc03-4e5e-a2c4-1568f1b70765 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.825562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.826848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.827350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.827860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.828914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:44.829426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:44.831609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:44.851095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 198/404] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:44.857943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.887599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:44.979575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4ece3-d74c-46e0-b65e-fb55d424b60e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.016321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50c555-cc03-4e5e-a2c4-1568f1b70765 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.021591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.022693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.023189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.023664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.025992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.027663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.029775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 199/405] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.036196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.059252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.097806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.098378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.098662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.099496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.101220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.102675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.104879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 207/406] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.105715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.164162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.175544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2520cb-bdc1-406a-8560-3f74a6168aad None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.220783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.221840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.222224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.223027 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.225159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.225907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e2159-251d-434d-ad81-bb0186a505a7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.226882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.230437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 200/407] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.231313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.288897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.290639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.292276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.292559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.307398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:45.314369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:45.315271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:45.316098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:45.319913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 208/408] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:45.320897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.361632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376f07-af64-4f70-a65b-fb13b5e29869 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.388550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.407335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.409639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.410309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.410821 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.413158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.415407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.417915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 201/409] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.419212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.454666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.464363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb70ed-ac7b-4565-899a-baec5e9a7eca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.504849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.505910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.506261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.506610 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/groups/a5e255a89e514a4db5fa84057b89172a/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.509030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] RBAC: Authorizing `identity:create_grant(project_id=365cf2fc54cd42cf94babc9a50eeab9f, group_id=a5e255a89e514a4db5fa84057b89172a, role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.510679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.533426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 209/410] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 17 16:02:45 2022] PUT /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/groups/a5e255a89e514a4db5fa84057b89172a/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:45.534455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.551371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8fd50-321a-43c9-9126-e6b774916292 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.595389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.596377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.596940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.597396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.598263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:45.598803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.600431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.617875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 202/411] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.619442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.705049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b8c1e-df11-4d06-8295-da787a1da9af None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.716414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.719912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.730660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7a6f4-cfa3-4abc-8d9a-a56196216e71 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.764536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c35fc-c3a5-49ce-a645-fe223db664b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.765225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c35fc-c3a5-49ce-a645-fe223db664b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.765499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c35fc-c3a5-49ce-a645-fe223db664b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.765780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c35fc-c3a5-49ce-a645-fe223db664b6 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/groups/a5e255a89e514a4db5fa84057b89172a/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.767754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c35fc-c3a5-49ce-a645-fe223db664b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=365cf2fc54cd42cf94babc9a50eeab9f, group_id=a5e255a89e514a4db5fa84057b89172a, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.769250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c35fc-c3a5-49ce-a645-fe223db664b6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.771451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded290e7-3bde-4953-96e9-f7fe6e34424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.772155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded290e7-3bde-4953-96e9-f7fe6e34424d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.772442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded290e7-3bde-4953-96e9-f7fe6e34424d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.772723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded290e7-3bde-4953-96e9-f7fe6e34424d None admin] PATH_INFO: `/v3/groups/49db2cfadb2445c18088af0516aab5c2` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.773940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded290e7-3bde-4953-96e9-f7fe6e34424d None admin] RBAC: Authorizing `identity:get_group(group_id=49db2cfadb2445c18088af0516aab5c2)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.775655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded290e7-3bde-4953-96e9-f7fe6e34424d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.777670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 203/412] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/groups/49db2cfadb2445c18088af0516aab5c2 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.783713 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa3919-8884-4678-ae5a-4b19fd9c133b None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.792300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 210/413] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 17 16:02:45 2022] PUT /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f/groups/a5e255a89e514a4db5fa84057b89172a/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:45.792418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa3919-8884-4678-ae5a-4b19fd9c133b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.792418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa3919-8884-4678-ae5a-4b19fd9c133b None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.792621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d812fd6-2c6c-43df-a957-6fe109d6ad4f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.792621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d812fd6-2c6c-43df-a957-6fe109d6ad4f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.792758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 204/414] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:45.792758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa3919-8884-4678-ae5a-4b19fd9c133b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.792876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d812fd6-2c6c-43df-a957-6fe109d6ad4f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.792876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 211/415] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:45.793666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a435-4cfa-45f5-9b15-5d5e43fcfc33 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.793975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a435-4cfa-45f5-9b15-5d5e43fcfc33 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.794226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a435-4cfa-45f5-9b15-5d5e43fcfc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.821451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b6d6a435-4cfa-45f5-9b15-5d5e43fcfc33 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:45.823001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b6d6a435-4cfa-45f5-9b15-5d5e43fcfc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:45.922244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 212/416] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:45.923999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a4ad-acec-4133-9383-c5215a8bf1a7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.925342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a4ad-acec-4133-9383-c5215a8bf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.925852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31a4ad-acec-4133-9383-c5215a8bf1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.945662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cd31a4ad-acec-4133-9383-c5215a8bf1a7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:45.947861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cd31a4ad-acec-4133-9383-c5215a8bf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:45.957988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa3919-8884-4678-ae5a-4b19fd9c133b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.997639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.998291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.998573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.998846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] PATH_INFO: `/v3/projects/8e2e0137191a4168b0b70f0ebaa36507` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.000029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] RBAC: Authorizing `identity:get_project(project_id=8e2e0137191a4168b0b70f0ebaa36507)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.001479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.003979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 205/417] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/projects/8e2e0137191a4168b0b70f0ebaa36507 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:46.010414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.038720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 213/418] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:46.048807 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.129307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150878-c069-4283-b9bc-cd9d998a46af None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.164800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.165483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.165768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.166045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] PATH_INFO: `/v3/projects/8e2e0137191a4168b0b70f0ebaa36507/groups/49db2cfadb2445c18088af0516aab5c2/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.168021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e2e0137191a4168b0b70f0ebaa36507, group_id=49db2cfadb2445c18088af0516aab5c2, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.169471 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.185417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 206/419] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Aug 17 16:02:46 2022] PUT /identity/v3/projects/8e2e0137191a4168b0b70f0ebaa36507/groups/49db2cfadb2445c18088af0516aab5c2/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:46.248626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31a4ad-acec-4133-9383-c5215a8bf1a7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.285397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.350407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.394526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31a4ad-acec-4133-9383-c5215a8bf1a7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.434331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.434998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.435277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.435606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.447376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:46.452418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:46.453315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:46.454755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 214/420] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:46.460486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.478736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.500859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be9214-39f3-4bc4-aea0-aa40d4c2bcb3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.541160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.541850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.542142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.542416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.562233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:46.565921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:46.569448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:46.570343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:46.571138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:46.576301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 207/421] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:46.581848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.582963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d929157-c392-4428-9789-ad28e3d29b79 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.621434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.622158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.622446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.622718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.623380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:46.623680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.625206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.635146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 215/422] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:46.641616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.740321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf92a4-8347-4de7-a404-d33b0e3bf987 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.777547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.778305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.778597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.778877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.779551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:46.779885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.781438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.790366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 208/423] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:46.800817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.825878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.840068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9827-07d8-4d66-9818-3bc5b5ef708a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.885357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.886325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.886837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.887349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.923374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.003346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7860a-a2fa-441d-b310-fa8588355ffa None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.026336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.028133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.067461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.068970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.069473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.070078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.174096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.176162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.186015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.246743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 216/424] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:47.251317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.341163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.359069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 209/425] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:47.363127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.450154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8776db-168d-4306-a0ea-68927070f5c6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.527045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.528078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.529531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.530021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.532788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.535833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.539138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 217/426] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:47.544522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.566093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8f86-2299-412c-bf15-520414948d85 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.574552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.605827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.606815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.607325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.607839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] PATH_INFO: `/v3/projects/258fc26104b542a6b4798666f4dd698d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.609348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] RBAC: Authorizing `identity:get_project(project_id=258fc26104b542a6b4798666f4dd698d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.611009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.613407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 210/427] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/projects/258fc26104b542a6b4798666f4dd698d => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.618933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.747769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0dd0-090c-420a-b73b-d7f5b69c9691 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.769961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de279d73-266b-4563-adc5-ceb43e37f22b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.790988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.792749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.793377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.793838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.795434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.797653 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.799968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 211/428] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:47.802555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.806023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.853860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.854822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.855111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.855390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.860549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.861390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.862150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.863976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 218/429] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.873066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.945620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b37ef-f12a-44a4-b32a-c4f3d74cdad6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.983564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798455-5a1b-45b4-9a74-d1729ddaa6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.984105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798455-5a1b-45b4-9a74-d1729ddaa6fe None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.984394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798455-5a1b-45b4-9a74-d1729ddaa6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.984718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798455-5a1b-45b4-9a74-d1729ddaa6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.985504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798455-5a1b-45b4-9a74-d1729ddaa6fe None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=258fc26104b542a6b4798666f4dd698d) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:47.985765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798455-5a1b-45b4-9a74-d1729ddaa6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.987324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56798455-5a1b-45b4-9a74-d1729ddaa6fe None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.994865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 212/430] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.996454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860ddfc-d41e-4478-a259-bb7d13498041 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.996747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860ddfc-d41e-4478-a259-bb7d13498041 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.997026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860ddfc-d41e-4478-a259-bb7d13498041 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.002867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 213/431] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:48.004416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2782ef2-ead8-4c87-94cb-3d0e031cff43 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.004704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2782ef2-ead8-4c87-94cb-3d0e031cff43 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.005639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2782ef2-ead8-4c87-94cb-3d0e031cff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.008444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33044a-7b86-46c9-9bc1-0a763406a185 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:48.027493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e2782ef2-ead8-4c87-94cb-3d0e031cff43 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:48.028842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e2782ef2-ead8-4c87-94cb-3d0e031cff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:48.051442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacf14f-933c-4992-bf5e-ea48f7966574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:48.052939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf14f-933c-4992-bf5e-ea48f7966574 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.053399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf14f-933c-4992-bf5e-ea48f7966574 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.053843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacf14f-933c-4992-bf5e-ea48f7966574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.054860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacf14f-933c-4992-bf5e-ea48f7966574 None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=258fc26104b542a6b4798666f4dd698d) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:48.055374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacf14f-933c-4992-bf5e-ea48f7966574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:48.057019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacf14f-933c-4992-bf5e-ea48f7966574 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:48.064441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 219/432] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=258fc26104b542a6b4798666f4dd698d&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:48.122083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 214/433] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:48.244682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1e3f-d573-4cf5-a33c-ef6bc74809a7 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.244973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1e3f-d573-4cf5-a33c-ef6bc74809a7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.245272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1e3f-d573-4cf5-a33c-ef6bc74809a7 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.246870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 220/434] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:48.252352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35200-0d44-4cb7-8dae-4f5f513f69c6 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.252776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35200-0d44-4cb7-8dae-4f5f513f69c6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.253058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35200-0d44-4cb7-8dae-4f5f513f69c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.275149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b4a35200-0d44-4cb7-8dae-4f5f513f69c6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:48.276714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b4a35200-0d44-4cb7-8dae-4f5f513f69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:48.310203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:48.352454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 215/435] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:48.413597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1e3f-d573-4cf5-a33c-ef6bc74809a7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:48.468623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:48.528085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1e3f-d573-4cf5-a33c-ef6bc74809a7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:48.564094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:48.565142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.565617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.565892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.578142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:48.583885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:48.585085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:48.585864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 221/436] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:48.590696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a35200-0d44-4cb7-8dae-4f5f513f69c6 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:48.633895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:48.717126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a35200-0d44-4cb7-8dae-4f5f513f69c6 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:48.759387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cdd4a-8f49-4a3f-ab60-e4ff054ed773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:48.760108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cdd4a-8f49-4a3f-ab60-e4ff054ed773 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.760394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cdd4a-8f49-4a3f-ab60-e4ff054ed773 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.760673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cdd4a-8f49-4a3f-ab60-e4ff054ed773 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.761199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499ef90-825a-472c-8c3c-b042fbdba753 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:48.761380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cdd4a-8f49-4a3f-ab60-e4ff054ed773 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:48.761658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cdd4a-8f49-4a3f-ab60-e4ff054ed773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:48.763049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cdd4a-8f49-4a3f-ab60-e4ff054ed773 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:48.772093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 216/437] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:48.773125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:48.773305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391c39-da1d-4724-92ed-aa01785283b5 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.773595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391c39-da1d-4724-92ed-aa01785283b5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.773876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e391c39-da1d-4724-92ed-aa01785283b5 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.775146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 217/438] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:48.780190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391c39-da1d-4724-92ed-aa01785283b5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:48.800684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c08355-24d6-4834-b48f-9f2746e8ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:48.801309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c08355-24d6-4834-b48f-9f2746e8ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.801586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c08355-24d6-4834-b48f-9f2746e8ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.802612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c08355-24d6-4834-b48f-9f2746e8ccf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.809800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:48.816811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c08355-24d6-4834-b48f-9f2746e8ccf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-72c08355-24d6-4834-b48f-9f2746e8ccf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:48.822899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:48.823877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:48.824667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 222/439] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:48.828379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996991b5-b0d0-4a35-8a89-e725133d4da0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.828379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996991b5-b0d0-4a35-8a89-e725133d4da0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.828379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996991b5-b0d0-4a35-8a89-e725133d4da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.844711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-996991b5-b0d0-4a35-8a89-e725133d4da0 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:48.845928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-996991b5-b0d0-4a35-8a89-e725133d4da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:48.893291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e391c39-da1d-4724-92ed-aa01785283b5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:48.913046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 223/440] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:48.914469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996991b5-b0d0-4a35-8a89-e725133d4da0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:48.926333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:48.927630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.927957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.928230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.002527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.004339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.029750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.033664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996991b5-b0d0-4a35-8a89-e725133d4da0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.034661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.074400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.075500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.076181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.076462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.077134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:49.077440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.078810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.087825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 224/441] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:49.093009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.112665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 218/442] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:49.118451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.212072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf2eea-71a5-42f1-957c-a173169e1c35 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.220738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb13c-0cb9-49bc-af68-dbf61631cc5b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.247542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.248194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.248479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.248755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.248971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.258816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.259389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.259669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.260327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.261490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.262949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.264595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 219/443] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:49.265360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.277581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.319472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.320958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.362339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd838-13f6-4c33-9806-a938e9790ef9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.397174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.397921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.398273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.398617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.408599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:49.413941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:49.414894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:49.415690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 220/444] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:49.416847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.417921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 225/445] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:49.420913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.472375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.479183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.517241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601344f1-4679-4a56-975b-adfba683e773 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.519432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172c332-62a5-4cca-8604-80ea997966dd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.551077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.551738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.552060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.552337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.553175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.553446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.553783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.554064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.554336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.554950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.555048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:49.555354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.556549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 221/446] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:49.556730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.557310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.565125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 226/447] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:49.565908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.659284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd2fef-846c-42ba-9fa0-a874508e909b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.665526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca612e0-f680-466e-ac57-f450ed5e998e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.682292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.686931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.694128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.694771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.695053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.695333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] PATH_INFO: `/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.696467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] RBAC: Authorizing `identity:get_project(project_id=365cf2fc54cd42cf94babc9a50eeab9f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.697930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.698873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.699473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.699561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 222/448] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/projects/365cf2fc54cd42cf94babc9a50eeab9f => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:49.699759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.700058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.700341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.700782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:49.701093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.702507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.709188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 227/449] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:49.709865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.816459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9416dd8-146b-4e29-96c4-c5a1d0eede77 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.832419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d467e-db66-41c3-bde2-0a5859be990e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.862062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.863008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.864057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.864057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.875841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.877322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.877322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.877507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] PATH_INFO: `/v3/groups/a5e255a89e514a4db5fa84057b89172a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.878993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] RBAC: Authorizing `identity:get_group(group_id=a5e255a89e514a4db5fa84057b89172a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.881063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.883501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 228/450] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/groups/a5e255a89e514a4db5fa84057b89172a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:49.889049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.929074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.939678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.941253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.957044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:50.002868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b56ae-5af5-48e3-8ced-b3441b5e6d54 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.037052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.037667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.037944 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.038217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.038939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] RBAC: Adding query filter params (group.id=a5e255a89e514a4db5fa84057b89172a, role.id=c8ae3e3da796422fab32e4d6a86a89d5, scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:50.039247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:50.039508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 223/451] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:50.040758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:50.045234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:50.052502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 229/452] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/role_assignments?group.id=a5e255a89e514a4db5fa84057b89172a&scope.project.id=365cf2fc54cd42cf94babc9a50eeab9f&role.id=c8ae3e3da796422fab32e4d6a86a89d5 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:50.140969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:50.150823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726ef72-15a0-4524-b8d3-2482643c8d90 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.189282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.189924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.190202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.190472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] PATH_INFO: `/v3/projects/8e2e0137191a4168b0b70f0ebaa36507` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.193596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] RBAC: Authorizing `identity:get_project(project_id=8e2e0137191a4168b0b70f0ebaa36507)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:50.195064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:50.196736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 224/453] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:50 2022] GET /identity/v3/projects/8e2e0137191a4168b0b70f0ebaa36507 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:50.203040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:50.308915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37915f0-a035-47ab-b6df-0859b9147bcc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.326093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:50.342992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175284f-7a7c-400d-95e8-5db534a032b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.343628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175284f-7a7c-400d-95e8-5db534a032b3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.343952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175284f-7a7c-400d-95e8-5db534a032b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.344231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175284f-7a7c-400d-95e8-5db534a032b3 None admin] PATH_INFO: `/v3/groups/49db2cfadb2445c18088af0516aab5c2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.345340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175284f-7a7c-400d-95e8-5db534a032b3 None admin] RBAC: Authorizing `identity:get_group(group_id=49db2cfadb2445c18088af0516aab5c2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:50.346770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175284f-7a7c-400d-95e8-5db534a032b3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:50.349213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 230/454] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Aug 17 16:02:50 2022] GET /identity/v3/groups/49db2cfadb2445c18088af0516aab5c2 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:50.355210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:50.459671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f61e-242e-481c-ab89-4db0352c5d73 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.496000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5af7d-7440-4910-86f5-cd532c557afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.496618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5af7d-7440-4910-86f5-cd532c557afe None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.496898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5af7d-7440-4910-86f5-cd532c557afe None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.497170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5af7d-7440-4910-86f5-cd532c557afe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.497904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5af7d-7440-4910-86f5-cd532c557afe None admin] RBAC: Adding query filter params (group.id=49db2cfadb2445c18088af0516aab5c2, role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=8e2e0137191a4168b0b70f0ebaa36507) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:50.498215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5af7d-7440-4910-86f5-cd532c557afe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:50.499661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5af7d-7440-4910-86f5-cd532c557afe None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:50.506478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 225/455] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Aug 17 16:02:50 2022] GET /identity/v3/role_assignments?group.id=49db2cfadb2445c18088af0516aab5c2&scope.project.id=8e2e0137191a4168b0b70f0ebaa36507&role.id=b73be4c438e74c73b714b299c1412271 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:52.810984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da812-273f-40ae-b586-7ec357e798b8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.811503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da812-273f-40ae-b586-7ec357e798b8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.811503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0da812-273f-40ae-b586-7ec357e798b8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.813117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 231/456] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:52.818866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8083cb7-483a-43f7-869a-8f9a1519b06c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.819285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8083cb7-483a-43f7-869a-8f9a1519b06c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.819451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8083cb7-483a-43f7-869a-8f9a1519b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.849582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d8083cb7-483a-43f7-869a-8f9a1519b06c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:52.850712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d8083cb7-483a-43f7-869a-8f9a1519b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:52.874279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:52.946140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 226/457] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:52.981683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88e23-5120-4215-b8d7-c94e421834d2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.981956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88e23-5120-4215-b8d7-c94e421834d2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.982226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88e23-5120-4215-b8d7-c94e421834d2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.983686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 232/458] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:52.988874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bcb71-99e6-45e1-ac4f-98fe3902d6dd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.989696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bcb71-99e6-45e1-ac4f-98fe3902d6dd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.989978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bcb71-99e6-45e1-ac4f-98fe3902d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.022153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-251bcb71-99e6-45e1-ac4f-98fe3902d6dd None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:53.023365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-251bcb71-99e6-45e1-ac4f-98fe3902d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:53.111336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 227/459] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:53.300091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148818-f2ff-41e5-ac7d-a0534ed64765 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.300456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148818-f2ff-41e5-ac7d-a0534ed64765 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.300655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148818-f2ff-41e5-ac7d-a0534ed64765 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.302473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 233/460] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:53.307574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e838c4a-f92c-41c2-9cc1-4e29f58496fb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.307891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e838c4a-f92c-41c2-9cc1-4e29f58496fb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.308170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e838c4a-f92c-41c2-9cc1-4e29f58496fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.333540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7e838c4a-f92c-41c2-9cc1-4e29f58496fb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:53.334842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7e838c4a-f92c-41c2-9cc1-4e29f58496fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:53.425962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 228/461] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:53.462709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2148818-f2ff-41e5-ac7d-a0534ed64765 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:53.474012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e838c4a-f92c-41c2-9cc1-4e29f58496fb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:53.505874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:53.657303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2148818-f2ff-41e5-ac7d-a0534ed64765 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:53.673784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e838c4a-f92c-41c2-9cc1-4e29f58496fb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:53.723462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:53.724910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.725193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.725476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.745249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:53.745903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.746181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.746452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.747758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:53.749269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:53.760940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:53.762729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:53.767055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:53.768000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:53.768874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:53.768874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:53.768874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:53.774056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 234/462] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:53.775216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:53.784948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:53.785836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:53.787356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:53.787356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:53.787356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:53.789225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 229/463] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:53.792691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:53.837976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:53.877012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:53.904816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c39d-e8e9-45d5-baca-ded3225ad332 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:53.917376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc432b9-c340-4308-b0c3-eeac8e04e7e5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:53.946246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eac7e-1240-41d0-9c33-15746300b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:53.946886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eac7e-1240-41d0-9c33-15746300b93f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.947172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eac7e-1240-41d0-9c33-15746300b93f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.947448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eac7e-1240-41d0-9c33-15746300b93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.953493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:53.954270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.955234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.955658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.956960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:53.957438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:53.958683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eac7e-1240-41d0-9c33-15746300b93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:53.959574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:53.960152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eac7e-1240-41d0-9c33-15746300b93f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:53.974998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 230/464] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-221eac7e-1240-41d0-9c33-15746300b93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:53.975263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:53.976136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:53.976953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:53.976953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:53.976953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:53.976953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 235/465] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:53.977776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615e20-0f4b-4c52-8d97-8340c1bf259e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.978059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615e20-0f4b-4c52-8d97-8340c1bf259e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.978252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:53.978351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d615e20-0f4b-4c52-8d97-8340c1bf259e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.983606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 236/466] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:53.984531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d615e20-0f4b-4c52-8d97-8340c1bf259e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.083612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.096966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d615e20-0f4b-4c52-8d97-8340c1bf259e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.097354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1a82-a891-4b1f-932d-f542662df3dd None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.125101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.133654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f62fe-a1a3-4be6-a117-3f47cde292a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.134275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f62fe-a1a3-4be6-a117-3f47cde292a2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.134596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f62fe-a1a3-4be6-a117-3f47cde292a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.134834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f62fe-a1a3-4be6-a117-3f47cde292a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.135489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f62fe-a1a3-4be6-a117-3f47cde292a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:54.135819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f62fe-a1a3-4be6-a117-3f47cde292a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.137203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f62fe-a1a3-4be6-a117-3f47cde292a2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.137739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.138499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.138917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.139340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.140018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.141505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.153411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 231/467] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:54.153411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27697257-ed1b-439c-8ff5-98e79b763551 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.153411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27697257-ed1b-439c-8ff5-98e79b763551 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.153411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27697257-ed1b-439c-8ff5-98e79b763551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.168530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 237/468] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:53 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:54.169190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.178064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-27697257-ed1b-439c-8ff5-98e79b763551 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:54.179887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-27697257-ed1b-439c-8ff5-98e79b763551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:54.257695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 232/469] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:54.258894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27697257-ed1b-439c-8ff5-98e79b763551 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.306933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2112-d4d0-4c06-ad50-4fa4b72a3784 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.359363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f1509-a192-4c6d-83e0-b61e4313e8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.360096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f1509-a192-4c6d-83e0-b61e4313e8de None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.360096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f1509-a192-4c6d-83e0-b61e4313e8de None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.360354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f1509-a192-4c6d-83e0-b61e4313e8de None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.360967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f1509-a192-4c6d-83e0-b61e4313e8de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:54.361554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f1509-a192-4c6d-83e0-b61e4313e8de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.362636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f1509-a192-4c6d-83e0-b61e4313e8de None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.376346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 238/470] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:54.378830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682f1e6-3bcd-4a61-a6a0-27213f246d5c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.379120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682f1e6-3bcd-4a61-a6a0-27213f246d5c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.379400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682f1e6-3bcd-4a61-a6a0-27213f246d5c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.385844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 239/471] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:54.386602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682f1e6-3bcd-4a61-a6a0-27213f246d5c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.392444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27697257-ed1b-439c-8ff5-98e79b763551 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.396326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.413542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.440086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94701844-fafa-40fc-89da-119e266032d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.441070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701844-fafa-40fc-89da-119e266032d4 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.441413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701844-fafa-40fc-89da-119e266032d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.441754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701844-fafa-40fc-89da-119e266032d4 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.444019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94701844-fafa-40fc-89da-119e266032d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.444641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94701844-fafa-40fc-89da-119e266032d4 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.476078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 233/472] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:54 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:54.477719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363c3b-06c3-4cb5-a5ec-eee041d4f5ad None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.478257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363c3b-06c3-4cb5-a5ec-eee041d4f5ad None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.478775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81363c3b-06c3-4cb5-a5ec-eee041d4f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.502110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-81363c3b-06c3-4cb5-a5ec-eee041d4f5ad None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:54.504114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-81363c3b-06c3-4cb5-a5ec-eee041d4f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:54.559832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682f1e6-3bcd-4a61-a6a0-27213f246d5c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.594673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 234/473] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:54.595784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363c3b-06c3-4cb5-a5ec-eee041d4f5ad None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.608853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.609866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.610909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.611435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.612415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.614609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.643464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 240/474] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:54 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:02:54.748026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81363c3b-06c3-4cb5-a5ec-eee041d4f5ad None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.751639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.794804 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.795748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.796251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.796699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.807985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.809722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:54.826531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:54.827443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:54.828316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:54.828316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:54.828316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:54.829802 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 235/475] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:54.839595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.906073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.916718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.970697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00184a-1ea8-40f6-8c1e-9ae8ebab3680 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.010535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.011146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.011421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.011826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.012481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:55.012786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.014147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.028212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 241/476] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:55.037849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:55.048950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff302-1bef-4d0b-9a57-6fe07ea55a0b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.088711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.089673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.090093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.090762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.092048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.093749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.104920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.sql.core [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 16:02:55.104920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 16:02:55.104920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [parameters: {'id': '620d6a6600b247e482f21eaaa78d8f13', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 16:02:55.104920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81704) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result.read() Aug 17 16:02:55.124557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:02:55.125644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application yield resource Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise self.value Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application session.commit() Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:02:55.126753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:02:55.127855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:02:55.128902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result.read() Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:02:55.129987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [parameters: {'id': '620d6a6600b247e482f21eaaa78d8f13', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:55.131442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 16:02:55.132382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:55.135266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 236/477] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 17 16:02:54 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:55.141875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:55.180862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:55.270766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7bc38-54ee-492a-a438-e6d07ed99ed0 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.324757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741322f-6855-4855-a1d3-47795de3b377 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.341085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.341658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.341938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.342217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.358550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:55.364647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:55.366365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:55.367327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 237/478] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:55.375124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:55.377319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:55.395020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cbc47-bfe8-4ee8-a4ad-bd31a60682a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.396060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cbc47-bfe8-4ee8-a4ad-bd31a60682a9 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.396437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cbc47-bfe8-4ee8-a4ad-bd31a60682a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.396718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cbc47-bfe8-4ee8-a4ad-bd31a60682a9 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.397365 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cbc47-bfe8-4ee8-a4ad-bd31a60682a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.400822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cbc47-bfe8-4ee8-a4ad-bd31a60682a9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.435264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 242/479] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:55 2022] POST /identity/v3/users => generated 249 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:55.518276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:55.544233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c7ba-6143-48e4-80ef-55bc9382978e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.581906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f040baa-24c4-4799-88e7-61e84f13399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.582534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040baa-24c4-4799-88e7-61e84f13399f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.582869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040baa-24c4-4799-88e7-61e84f13399f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.583286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f040baa-24c4-4799-88e7-61e84f13399f None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.584217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040baa-24c4-4799-88e7-61e84f13399f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:55.584522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040baa-24c4-4799-88e7-61e84f13399f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.585939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f040baa-24c4-4799-88e7-61e84f13399f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.595896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 238/480] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:56.457691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e0d4-2666-4cd6-b8d8-bc0a37e40992 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:56.458865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e0d4-2666-4cd6-b8d8-bc0a37e40992 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:56.459194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e0d4-2666-4cd6-b8d8-bc0a37e40992 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:56.460812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 243/481] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:56.466263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9d6af-80e3-4a1d-a5d1-16eeced77bdb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:56.466676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9d6af-80e3-4a1d-a5d1-16eeced77bdb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:56.466847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9d6af-80e3-4a1d-a5d1-16eeced77bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:56.494661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5ed9d6af-80e3-4a1d-a5d1-16eeced77bdb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:56.495876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5ed9d6af-80e3-4a1d-a5d1-16eeced77bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:56.590423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 239/482] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:56.980459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e0d4-2666-4cd6-b8d8-bc0a37e40992 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.038936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09a48f-05e0-479a-93ad-7e89bd97b8e8 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.039260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09a48f-05e0-479a-93ad-7e89bd97b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.039499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09a48f-05e0-479a-93ad-7e89bd97b8e8 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.041182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 240/483] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:57.046400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb09a2b-a699-47d3-b1cc-8d72fa582afd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.046686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb09a2b-a699-47d3-b1cc-8d72fa582afd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.046957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb09a2b-a699-47d3-b1cc-8d72fa582afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.080891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9cb09a2b-a699-47d3-b1cc-8d72fa582afd None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:57.082099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9cb09a2b-a699-47d3-b1cc-8d72fa582afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:57.129487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e0d4-2666-4cd6-b8d8-bc0a37e40992 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.168319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:57.173511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 241/484] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:57.174846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51394-d717-44e9-bdd7-9fe5405b6e40 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.175198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51394-d717-44e9-bdd7-9fe5405b6e40 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.175712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51394-d717-44e9-bdd7-9fe5405b6e40 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.178084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 242/485] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:57.179194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.187825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.187825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.187825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.192254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:57.194280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f82fea-3474-475f-8ce4-574267106041 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.194745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f82fea-3474-475f-8ce4-574267106041 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.195200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f82fea-3474-475f-8ce4-574267106041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:57.197319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:57.198284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:57.199079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 244/486] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:02:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:57.207290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.248799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b7f82fea-3474-475f-8ce4-574267106041 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:57.249999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b7f82fea-3474-475f-8ce4-574267106041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:57.255048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:57.324728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5008be3-8979-49d7-b7cf-2f1cd685c8ee None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.360866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.361474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.361755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.362032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.362705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:57.363013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:57.364957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:57.375241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 245/487] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:57.380864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.433277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 243/488] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:57.508123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:57.510991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fccba-3d0c-4266-a250-335f2254c6a1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.527147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f82fea-3474-475f-8ce4-574267106041 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.580522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.581416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.581870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.582286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.606082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:57.607765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:57.634800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:57.635921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:57.636915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:57.636915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:57.636915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:57.648152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 246/489] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:57.652882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f82fea-3474-475f-8ce4-574267106041 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.653753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.686833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:57.694333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.695176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.695611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.696068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.708209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:57.713588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:57.714635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:57.715628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:57.717616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 244/490] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:57.722715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.804703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b773c-312d-48f4-91fe-6795dc2bfa45 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.863706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.864617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.865046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.865964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.866812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:57.867701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:57.869530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:57.887569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 247/491] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:57.888670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.896852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a24c02-8a36-4fcf-9d29-ca543f46e709 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.906424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:57.937663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.938438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.938812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.939184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.940011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:57.940413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:57.941982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:57.956386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 245/492] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:57.957454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.017222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.023455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9834b-9eb5-4c68-8463-5e68c3ae9acb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.061311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.061946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.062226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.062503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.069289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330981d-4f90-475e-b355-6d4123fb55d6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.072971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:58.077712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:58.078601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:58.079395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 248/493] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:58.080107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.107834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361d673-64b4-43a8-8495-04244fcb1d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.108461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361d673-64b4-43a8-8495-04244fcb1d91 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.108746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361d673-64b4-43a8-8495-04244fcb1d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.109034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361d673-64b4-43a8-8495-04244fcb1d91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.116943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361d673-64b4-43a8-8495-04244fcb1d91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.118395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361d673-64b4-43a8-8495-04244fcb1d91 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-5361d673-64b4-43a8-8495-04244fcb1d91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:02:58.130747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:58.131667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:58.132611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 246/494] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:58.133186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab372-4f52-4d50-99bc-2dfefd3abebe None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.133788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab372-4f52-4d50-99bc-2dfefd3abebe None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.133788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab372-4f52-4d50-99bc-2dfefd3abebe None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.138909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 247/495] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:58.138909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2991f8-c058-4697-9bb1-e1c791f48d79 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.138909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2991f8-c058-4697-9bb1-e1c791f48d79 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.138909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2991f8-c058-4697-9bb1-e1c791f48d79 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.138909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 248/496] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:58.138909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2991f8-c058-4697-9bb1-e1c791f48d79 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.151189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.182527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228e974-94ef-4ae7-bb8e-5e9b0fdb34a6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.217368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.218006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.218286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.218559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.229489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.230974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:58.246109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:58.247136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:58.248372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:58.248372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:58.248372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:58.248923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2991f8-c058-4697-9bb1-e1c791f48d79 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.252046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 249/497] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:58.252863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.262367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.284174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0dbd-4c72-416e-8d44-ce8b335c59b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.285003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0dbd-4c72-416e-8d44-ce8b335c59b3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.285288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0dbd-4c72-416e-8d44-ce8b335c59b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.285567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0dbd-4c72-416e-8d44-ce8b335c59b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.286408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0dbd-4c72-416e-8d44-ce8b335c59b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:58.286711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0dbd-4c72-416e-8d44-ce8b335c59b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.288133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0dbd-4c72-416e-8d44-ce8b335c59b3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.296327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 249/498] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:58.297472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d05d-3515-4c97-80b7-4c20f081ee2e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.297754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d05d-3515-4c97-80b7-4c20f081ee2e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.298028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d05d-3515-4c97-80b7-4c20f081ee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.315788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cd12d05d-3515-4c97-80b7-4c20f081ee2e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:58.317626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cd12d05d-3515-4c97-80b7-4c20f081ee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:58.353643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c58730-39cd-4ad3-8526-5e44347b8b5f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.376908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.385656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 250/499] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:58.386891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054dfe-8633-40d4-8386-5d4fcc334f41 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.387178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054dfe-8633-40d4-8386-5d4fcc334f41 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.387454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0054dfe-8633-40d4-8386-5d4fcc334f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.389241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.389795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.390071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.390343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.391075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:58.391386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.392821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.413169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e0054dfe-8633-40d4-8386-5d4fcc334f41 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:58.414376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e0054dfe-8633-40d4-8386-5d4fcc334f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:58.431343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 250/500] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:58.436596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.483211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 251/501] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:58.488499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054dfe-8633-40d4-8386-5d4fcc334f41 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.529065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.568739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e3ceb-cc39-4475-b424-06e9ff6ea898 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.609194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.610075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.610454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.610862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.611575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:58.612006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.613680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.617866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0054dfe-8633-40d4-8386-5d4fcc334f41 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.630862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 251/502] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:58.630862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.666056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.666622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.666902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.667175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.678359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.679203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.680827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:58.696123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:58.697057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:58.697918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:58.697918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:58.697918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:58.697918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 252/503] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:58.698129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.743845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2a71-f356-42ef-a347-c9d7b2bde7ab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.778520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.779126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.779404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.779674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.791082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.806617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92cfa4-9e85-4e75-9efe-4dadae22e74b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.843083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.843723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.844034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.844310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.847906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.850108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.852839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.854555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:02:58.866430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:58.867322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:58.868235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 253/504] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:58.868776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.900047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.958920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 252/505] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:58.959669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.975759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8b956-16ee-4840-989a-1fd6e9939297 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.010068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.010701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.010986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.011263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.021944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:59.027143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:59.028051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:59.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 254/506] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:59.029538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.038017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.062505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20f7ca-1baa-4a8b-ad3f-d753f73ed998 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.097154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.097808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.098138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.098988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.099630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.099965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.101335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.112740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 253/507] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:59.113696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.116352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.128794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae655b-f85e-48cb-bc5e-bd50409c84ba None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.162677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.163307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.163584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.163897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.174353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.175826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:59.190214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:59.191105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:59.192070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:59.192070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:59.192070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:59.192070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 255/508] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:59.192661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.215655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697119-5068-407d-81a5-4022e11ae2d7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.249554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.250154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.250426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.250700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.250831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.251430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.251768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.253616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.270316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 254/509] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:59.272202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.294052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e330cb-bce8-4ed1-be4c-b09c65345712 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.327752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.328411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.328693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.328966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.332638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.340021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.341482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:59.356366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:59.357301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:59.358145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:59.358145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:59.358145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:59.358145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 256/510] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:59.358367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.378509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705d7eb-6d82-43c8-806e-867e19a3bc2f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.413523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.414126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.414407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.414679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.415342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.415642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.417036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.424868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 255/511] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:59.425639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.455837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320b223-ee08-4b71-a7de-ede22190491f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.465924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.490332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.490987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.491273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.491550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.498882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.500374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:02:59.511408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:59.512431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:02:59.513326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:02:59.518126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 257/512] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:59.518891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.527882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0f6b7-c964-40d8-bbbc-97b72a0c1dab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.550462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.562748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.563359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.563641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.563949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.564599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.564905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.566277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.578434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 256/513] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:59.579226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.624011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65205a-9b5b-4bc4-9386-00ff437ed958 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.656881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.657482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.657764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.658040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.682216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31778e4f-b151-463c-9fde-35b805828290 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.696810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.716430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.717056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.717413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.717761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.718479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.718856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.720332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.725443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.726893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.731745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 257/514] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:59.732620 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.774875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.827559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 258/515] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:59.828657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.831100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b3326-834e-4bae-bdd5-d6ae3c98e074 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.865399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.866285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.866666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.866937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.877392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.878823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:59.893125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:59.894183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:59.895085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:59.895085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:59.895085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:02:59.895085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 258/516] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:59.895085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.900520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.932505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856663e-527c-43a9-9b03-853f85bfb933 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.966038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.966689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.966914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.967182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.967936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.968240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.969692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.988354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.995656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f625ea-8b00-4a67-b832-b49a194cdae0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.008153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 259/517] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:00.009103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.030429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.031040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.031320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.031597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.032274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.033706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.056217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 259/518] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:59 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:00.057237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.121600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca486-3245-4132-a2b9-f2231eaa1d53 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.153173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:00.163995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.164771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.165051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.165321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.173725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.174619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3642bf5-af15-42d0-bdbf-595bfef8d0ff None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.175213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:00.189021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:00.190113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:00.191074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 260/519] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:00.191641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.216123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.216827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.217631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.217631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.230934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.232496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:00.249550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:00.250673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:00.251545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:00.251545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:00.251545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:00.251545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 260/520] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:00.252580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.256151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:00.311304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456acac7-1228-4e85-8b27-88a1b1a665e9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.347974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.348904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.349294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.349571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.350215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:00.350530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.351931 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.361163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f8977-96c8-4eca-bc27-6c54378febdd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.363453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 261/521] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:00.365071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.403772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.404493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.404844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.405223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.421176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:00.476410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b6106-1ea6-47b4-88fc-04ebcf3e0653 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.479022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.480776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.482751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:00.514438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.515055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.515345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.515618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.516355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:00.516661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.518591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.536551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 262/522] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:00.537384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.602880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 261/523] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:00.603871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.654160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a429be-c40f-46bd-b507-9711f89defa3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.665962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:00.693716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.694329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.694610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.694875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.695525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:00.695857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.697240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.710702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 263/524] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:00.713048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.714078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be65b86-0c59-4c96-94b3-1eb0716489b5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.715666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:00.752462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.753065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.753353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.753627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.761811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.763382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:00.780677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:00.781707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:00.782589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 262/525] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:00.783150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.821959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f32844-9fac-4a1d-8afb-ba5d54c6d87b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:00.859130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:00.859428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.859709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.860008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.860724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=352b7e4d311d491f8e665d4cf7e554b8) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:00.861030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:00.862469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:00.868646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 264/526] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/role_assignments?user.id=352b7e4d311d491f8e665d4cf7e554b8&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:00.869421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:00.912730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:00.948068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b238a-c3b3-4c5c-a9ae-b5c0a1ca2d20 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.000828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.001601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.001992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.002606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.011792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbfea1-08ed-43f0-b1a7-a74281c69c4d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.015945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.017549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:01.036731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:01.037708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:01.038556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:01.038556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:01.038556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:01.040680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 263/527] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:01.041700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.056561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.057532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.057815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.058091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.060611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.067147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.068714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:01.085547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:01.086431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:01.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:01.091247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 265/528] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:01.092594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.158450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5e762-7da4-4fa5-a867-755689c6f2ea None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.201711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.203003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.203902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.204376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.205307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:01.205808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.209127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.211522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.221263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b7adc-7835-4f12-95ce-22ff12072bcb None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.234881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 264/529] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:01.236342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.259304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.259971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.260260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.260538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.261386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:01.261647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.263083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.276996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 266/530] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:01.277858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.328833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.374735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f60650-af29-4c2a-823e-dd7c3d699ca3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.403534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fcad5-db03-4073-adc7-6f8b8ec7c6dc None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.414964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.415959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.416443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.416917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.417836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:01.418345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.420028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.444091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 265/531] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:01.445129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.445591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.445785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.446022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.446292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.475770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.540398 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.542540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.561826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6f5bd-6e9d-4af6-9d56-a0239570d907 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.596413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.605262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.605989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.606180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.606552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.616634 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.618312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:01.634693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:01.635618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:01.636532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:01.639948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 266/532] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:01.640999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.675982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 267/533] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:01.678926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.754430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.760766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae45d5-a253-418d-ad17-9b9d025aab97 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.798959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.800066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.800561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.801052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.802012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=009c623055dc4defa2bd74a82c6a7e43) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:01.802550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.804238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.810143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 267/534] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/role_assignments?user.id=009c623055dc4defa2bd74a82c6a7e43&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:01.816898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1ccca-be62-45c2-81fa-26505fe25955 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.817371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.870673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.871307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.871585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.871879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.872587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:01.872889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.874344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.912030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 268/535] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:01.925454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.934460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.023038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10549140-9760-4220-af57-71b9d07633c4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.062845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345316-9597-4ed2-8ccd-73ae10af560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.063797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345316-9597-4ed2-8ccd-73ae10af560f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.064308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345316-9597-4ed2-8ccd-73ae10af560f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.064781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345316-9597-4ed2-8ccd-73ae10af560f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.076848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345316-9597-4ed2-8ccd-73ae10af560f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.078599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345316-9597-4ed2-8ccd-73ae10af560f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-41345316-9597-4ed2-8ccd-73ae10af560f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:02.095963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:02.096922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:02.097770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:02.097770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:02.097770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:02.097943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7997e-1e40-42ef-8d7a-c54304be51b8 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.100503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 268/536] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:02.101949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf708e-f8ba-41ba-985d-df1c8822602d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.102477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf708e-f8ba-41ba-985d-df1c8822602d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.102949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf708e-f8ba-41ba-985d-df1c8822602d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.104689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 269/537] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:02.106096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf708e-f8ba-41ba-985d-df1c8822602d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.126027 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.151190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fa324-512e-4edc-ba79-a280531aa2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.151823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fa324-512e-4edc-ba79-a280531aa2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.152113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fa324-512e-4edc-ba79-a280531aa2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.152391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fa324-512e-4edc-ba79-a280531aa2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.153168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fa324-512e-4edc-ba79-a280531aa2d0 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=3474a82d27d04dcc9b9818608b00fb48) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:02.153515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fa324-512e-4edc-ba79-a280531aa2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.155031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fa324-512e-4edc-ba79-a280531aa2d0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.161583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 269/538] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/role_assignments?user.id=3474a82d27d04dcc9b9818608b00fb48&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:02.162827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a891-ed97-4c3c-a09a-67383146d812 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.163118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a891-ed97-4c3c-a09a-67383146d812 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.163396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a891-ed97-4c3c-a09a-67383146d812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.182813 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-8007a891-ed97-4c3c-a09a-67383146d812 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:02.184306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8007a891-ed97-4c3c-a09a-67383146d812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:02.278906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 270/539] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:02.308586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf708e-f8ba-41ba-985d-df1c8822602d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.323291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.352015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.352630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.352914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.353190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.353958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:02.354570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.356083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.372053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 270/540] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:02.377531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a891-ed97-4c3c-a09a-67383146d812 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.504753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a891-ed97-4c3c-a09a-67383146d812 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.512819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.543550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.544208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.544550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.544837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.552126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.553592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:02.565257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:02.566073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:02.566971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 271/541] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:02.573658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.647992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.690637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6974b0-fc12-4778-8036-ae75b912d538 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.729378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.730370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.730859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.731433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.732495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:02.732999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.734651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.747888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 271/542] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:02.754296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.764108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e9230-ac7d-44a1-9d13-1ba4d6a24305 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.786059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.804539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.805456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.805884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.806301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.818989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:02.824618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:02.825512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:02.826323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:02.828632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 272/543] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:02.835107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.866953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.874296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45587b-0586-4163-a8c5-6379e8706b64 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.917992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd342e0f-a8db-44f7-833f-7b8c3941ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.917992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342e0f-a8db-44f7-833f-7b8c3941ba27 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.918344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342e0f-a8db-44f7-833f-7b8c3941ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.919301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd342e0f-a8db-44f7-833f-7b8c3941ba27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.919646 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd342e0f-a8db-44f7-833f-7b8c3941ba27 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=13729a757e1a4f95a957fedb84705960) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:02.920047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd342e0f-a8db-44f7-833f-7b8c3941ba27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.921554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd342e0f-a8db-44f7-833f-7b8c3941ba27 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.929597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 272/544] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/role_assignments?user.id=13729a757e1a4f95a957fedb84705960&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:02.963743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39fd70-c713-4d0f-87e7-53827a58cc09 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:03.005812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:03.006738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.007218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.007322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8dcd-8aab-4a54-9d95-ed6018ae126a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.007777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.008740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:03.009208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:03.010853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:03.012353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8dcd-8aab-4a54-9d95-ed6018ae126a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.012866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8dcd-8aab-4a54-9d95-ed6018ae126a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.014936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 273/545] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:03.020626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a58f9-e966-4323-88db-2a0aa3138779 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.021150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a58f9-e966-4323-88db-2a0aa3138779 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.021506 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a58f9-e966-4323-88db-2a0aa3138779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.022060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 273/546] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:03.031023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:03.058688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-aa7a58f9-e966-4323-88db-2a0aa3138779 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:03.060232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-aa7a58f9-e966-4323-88db-2a0aa3138779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:03.131117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:03.145408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdb008-9e48-45a8-a7d9-6dbe7ef4ab3e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:03.161680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 274/547] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:03.187773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:03.188595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.188980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.189358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.202280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:03.203992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:03.219705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:03.220710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:03.221537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:03.221537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:03.221537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:03.221537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 274/548] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:03.228543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a58f9-e966-4323-88db-2a0aa3138779 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:03.255132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:03.376359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a58f9-e966-4323-88db-2a0aa3138779 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:03.445951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:03.446492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.446769 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.447036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.447685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:03.448011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:03.449443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:03.474132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 275/549] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:03.480968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:03.513821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:03.685468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba9814-059c-47c7-bf86-1dad62c16fbc None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:03.688076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:03.707267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbab563-dae9-4e30-97fe-134f115f6729 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:03.751288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:03.752728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.753181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.754810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.773206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:03.778861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:03.780487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:03.781527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:03.783668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 276/550] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:03.791690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:03.795585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.796044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.796467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.803845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:03.828671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:03.830479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:03.848351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:03.867463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:03.868470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:03.869371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:03.882658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 275/551] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:03.888896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:04.115876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac3a3-378c-4a41-ba7d-e57e7fd1ef40 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.128823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0da86f-f97b-4071-b200-e7401ac74c5d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.182052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.184143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.184415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.184691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.185369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:04.185676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.187046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:04.203474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.204139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.204418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.204698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.205440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:04.205746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.207197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:04.209575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 277/552] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:04.210477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:04.215119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:04.245695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 276/553] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 17 16:03:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:04.251964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:04.352064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bfee8-3f7b-4f57-b85c-2c9425026106 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.354599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:04.389957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a0586-d137-4032-a95e-c09cfc2f87e3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.393701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88863cf-2c3b-449b-833b-80a9c0e97cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.394426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88863cf-2c3b-449b-833b-80a9c0e97cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.395613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88863cf-2c3b-449b-833b-80a9c0e97cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.395613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88863cf-2c3b-449b-833b-80a9c0e97cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.406892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88863cf-2c3b-449b-833b-80a9c0e97cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.408609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88863cf-2c3b-449b-833b-80a9c0e97cc3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f88863cf-2c3b-449b-833b-80a9c0e97cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:04.423337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:04.424757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:04.426812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:04.426812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:04.426812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:04.426812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 278/554] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:04.428379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544283d-e0ad-44f9-9722-04708d5713af None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.428379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544283d-e0ad-44f9-9722-04708d5713af None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.428654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544283d-e0ad-44f9-9722-04708d5713af None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.432321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 279/555] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:04.432486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.432486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.432486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.432486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.434704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544283d-e0ad-44f9-9722-04708d5713af None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:04.505169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:04.508571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.510221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:04.559622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544283d-e0ad-44f9-9722-04708d5713af None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.592186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:04.595094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79882a-57be-47d1-8043-49029e0af2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.595970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79882a-57be-47d1-8043-49029e0af2cb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.596341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79882a-57be-47d1-8043-49029e0af2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.596689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79882a-57be-47d1-8043-49029e0af2cb None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.597412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79882a-57be-47d1-8043-49029e0af2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:04.597790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79882a-57be-47d1-8043-49029e0af2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.599848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79882a-57be-47d1-8043-49029e0af2cb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:04.614169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 280/556] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:04.615752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729264-bb87-45d7-8848-f51ffa2338a6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.616133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729264-bb87-45d7-8848-f51ffa2338a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.616479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729264-bb87-45d7-8848-f51ffa2338a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.633890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 277/557] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:04.634744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:04.635778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f3729264-bb87-45d7-8848-f51ffa2338a6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:04.637137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f3729264-bb87-45d7-8848-f51ffa2338a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:04.712594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 281/558] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:04.713748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3729264-bb87-45d7-8848-f51ffa2338a6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:04.746194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab2986-eefa-4db3-8f92-bc54ffc37a9a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.785394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebdb9a-229d-4146-86d9-dc9f009d4ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.786686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebdb9a-229d-4146-86d9-dc9f009d4ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.786964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebdb9a-229d-4146-86d9-dc9f009d4ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.787288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebdb9a-229d-4146-86d9-dc9f009d4ff4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.788811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:04.796987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebdb9a-229d-4146-86d9-dc9f009d4ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.798453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebdb9a-229d-4146-86d9-dc9f009d4ff4 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-c7ebdb9a-229d-4146-86d9-dc9f009d4ff4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:04.814310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:04.815758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 278/559] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:04.817263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59836-ede8-46c6-bb85-24a979d08ef0 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.817935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59836-ede8-46c6-bb85-24a979d08ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.817935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa59836-ede8-46c6-bb85-24a979d08ef0 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.819390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 279/560] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:04.828765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59836-ede8-46c6-bb85-24a979d08ef0 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:04.853639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:04.863329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3729264-bb87-45d7-8848-f51ffa2338a6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.900485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889168cb-faaa-437c-9c6b-00e4a60b34af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.901270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889168cb-faaa-437c-9c6b-00e4a60b34af None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.901670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889168cb-faaa-437c-9c6b-00e4a60b34af None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.902038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889168cb-faaa-437c-9c6b-00e4a60b34af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.913709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889168cb-faaa-437c-9c6b-00e4a60b34af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.915637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889168cb-faaa-437c-9c6b-00e4a60b34af None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-889168cb-faaa-437c-9c6b-00e4a60b34af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:04.932052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:04.933057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:04.933939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:04.933939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:04.933939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:04.933939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 282/561] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:04.935083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e67b7-b385-4513-bb4c-5f85bcbf6362 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.935360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e67b7-b385-4513-bb4c-5f85bcbf6362 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.935630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e67b7-b385-4513-bb4c-5f85bcbf6362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.953021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa59836-ede8-46c6-bb85-24a979d08ef0 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:04.954904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-926e67b7-b385-4513-bb4c-5f85bcbf6362 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:04.956770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-926e67b7-b385-4513-bb4c-5f85bcbf6362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:04.993055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:04.994085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:04.994717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:04.995193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:04.996184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:04.996667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:04.998463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.017932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 280/562] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:05.019131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.028765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 283/563] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:05.029538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e67b7-b385-4513-bb4c-5f85bcbf6362 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.062037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.114341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.144426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101f41-ae24-40a5-b406-f79236455dcc None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.160120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e67b7-b385-4513-bb4c-5f85bcbf6362 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.182587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.183462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.183575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.183949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.184670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:05.185046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.186505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.203698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 281/564] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:05.204752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.207434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.208618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.210260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.210729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.226893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:05.231989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:05.232917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:05.233750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:05.237878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 284/565] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:05.238765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.327169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9b7d1-157f-40c6-aa60-a380da5c0a65 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.331188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.345100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a570b2c-2f46-40c7-af36-f0989a0a84bf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.363239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.364766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.365045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.365320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.368014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.376635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.378125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.380392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.381022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.381300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.381573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.388153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.389567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:05.392147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:05.393119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:05.394012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:05.394012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:05.394012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:05.394012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 282/566] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:05.394012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:05.400813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:05.401659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:05.402529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:05.403566 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 285/567] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:05.403566 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.494459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc8857-82e4-4f5f-b54d-9ee2f3d0995d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.500965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c6d22-13e6-46cf-935f-5684a29780fd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.527669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7198d5a-2153-4772-a3fa-2c0713d17d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.528310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198d5a-2153-4772-a3fa-2c0713d17d82 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.528587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198d5a-2153-4772-a3fa-2c0713d17d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.528860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7198d5a-2153-4772-a3fa-2c0713d17d82 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.529520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198d5a-2153-4772-a3fa-2c0713d17d82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:05.529819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198d5a-2153-4772-a3fa-2c0713d17d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.531187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7198d5a-2153-4772-a3fa-2c0713d17d82 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.535008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.536340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.536619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.537313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.539691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 283/568] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:05.540874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc719f7-cfa1-4b5d-b6c6-968eb7ffadc0 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.541153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc719f7-cfa1-4b5d-b6c6-968eb7ffadc0 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.541423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc719f7-cfa1-4b5d-b6c6-968eb7ffadc0 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.542804 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 284/569] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:05.545291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc719f7-cfa1-4b5d-b6c6-968eb7ffadc0 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.547919 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:05.553233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:05.554312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:05.555150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 286/570] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:05.555865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.567831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.600946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.658028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc719f7-cfa1-4b5d-b6c6-968eb7ffadc0 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.662882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de4083-1419-4329-81d9-ba067a2b3414 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.691353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.692185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.692467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.692741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.693382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:05.693685 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.695056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.696376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abed7f-9710-46b0-870a-2605be0f0879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.696868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abed7f-9710-46b0-870a-2605be0f0879 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.697153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abed7f-9710-46b0-870a-2605be0f0879 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.697424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abed7f-9710-46b0-870a-2605be0f0879 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.698116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abed7f-9710-46b0-870a-2605be0f0879 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:05.698419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abed7f-9710-46b0-870a-2605be0f0879 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.699825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abed7f-9710-46b0-870a-2605be0f0879 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.706371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 285/571] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:05.707166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.716089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 287/572] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:05.716089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95c17-a817-4846-be75-68eb2e7a62db None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.716089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95c17-a817-4846-be75-68eb2e7a62db None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.716089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95c17-a817-4846-be75-68eb2e7a62db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.732156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0ff95c17-a817-4846-be75-68eb2e7a62db None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:05.733360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0ff95c17-a817-4846-be75-68eb2e7a62db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:05.795632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.801598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 288/573] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:05.802399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95c17-a817-4846-be75-68eb2e7a62db None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.832074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cefd91-197e-49f5-8521-6ae0a68a8a03 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.843779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.869934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.870558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.870846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.871117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.881849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.883875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:05.901096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:05.902089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:05.902983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:05.902983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:05.902983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:05.902983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 286/574] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:05.903214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.920267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95c17-a817-4846-be75-68eb2e7a62db None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.965124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.965738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.966015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.966304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.966952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:05.967257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:05.968653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:05.978438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 289/575] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:05.983885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.024442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73dcaf-efb6-45a3-beee-75648b955558 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.047495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.061133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.062034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.062311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.062587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.069336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.070837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:06.082855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:06.083974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:06.085059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:06.088391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 287/576] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:06.089219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.099493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c7853-2217-4d9f-9c40-06246de7399a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.114763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.133414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.134031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.134380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.134720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.135502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=52a56e6519a04ac297ef8f2e1094157f) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.135908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.137380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.142526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 290/577] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/role_assignments?user.id=52a56e6519a04ac297ef8f2e1094157f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.143282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.199362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817aade-cc87-4d44-bd99-f18efa913248 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.240210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.240840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.241120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.241399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.242057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.242363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.243761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.257815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd705-60d1-427b-a461-7efd45dd4c1a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.262881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 288/578] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.262881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.288445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.302898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.303675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.304088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.304450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.315839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.318024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:06.332706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:06.333858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:06.334743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:06.334743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:06.334743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:06.334743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 291/579] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:06.335320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.364082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.384690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a0a63-4c5b-4e29-bf26-e1c44005ca31 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.421201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.421833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.422351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.422351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.433585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:06.438323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:06.439245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 289/580] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:06.440772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.447390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e84ba-dac5-4abe-ba08-80b8a9915332 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.483871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.484480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.484756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.485023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.485712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.486018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.487436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.501276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 292/581] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.502317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.540163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.555671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0bac-5f88-4d14-8a33-93a7d31ed934 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.598433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.599220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.599766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.600164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.608997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bfa92-eab5-4be4-8585-a6bfbdbe30ca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.609896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.612557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:06.628241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:06.630187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:06.631438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:06.639488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 290/582] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:06.639488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.639488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.656138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.656888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.657270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.657664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.658413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.658819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.660934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.677515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 293/583] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.677515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.746686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef641c82-7c56-4d8e-9ae8-a641db190e98 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.776661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.780717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.781514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.781940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.782374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.783044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.783354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.784076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190902e-f37c-4b82-860d-1a87a85dd746 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.784786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.793972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 291/584] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.794795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.823824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.827012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.827012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.827012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/352b7e4d311d491f8e665d4cf7e554b8/roles/9c4b8b10d69d46b8aa4ecc21408597f2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.841752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=352b7e4d311d491f8e665d4cf7e554b8, role_id=9c4b8b10d69d46b8aa4ecc21408597f2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.843188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.857794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 294/585] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:06 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/352b7e4d311d491f8e665d4cf7e554b8/roles/9c4b8b10d69d46b8aa4ecc21408597f2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:06.867601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.868820 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.917235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd824157-7096-4f83-a181-e9cfa7d8465f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.969176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.970088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.970477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.970856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.971719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.972167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.974211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.999936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 292/586] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.999936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.026774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c5e76-36af-4dfa-a733-16b2b22fdddd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.077920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.079000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.079398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.079679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.088258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.089823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:07.103381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:07.104751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:07.105684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 295/587] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:07.106909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.118257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.134084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533a15-f343-409b-a26d-60d3ea6cdb6d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.168278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.184419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.185626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.186092 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.186547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.200063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.202448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.221680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da4141-7ea8-428a-99ff-91b3f028609d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:07.223283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:07.224293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:07.225205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:07.225205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:07.225205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:07.233583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 293/588] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:07.234859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.268504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.270494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.271114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.271679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.288671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.290321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:07.309717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:07.310996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:07.312110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:07.312110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:07.312110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:07.315878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 296/589] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:07.317095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.371011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e910d1b-5da7-4921-8164-f3172aae315f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.396150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.414971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.415866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.416295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.416716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.417596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:07.418071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.420212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.447524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 294/590] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.447524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.464072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccbcf6-1c32-4dff-8c7f-b6e39c29ce48 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.481167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.509138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.510389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.511089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.511515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.512496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:07.512949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.515059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.534292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 297/591] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.534292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.574736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7a537-d5b3-4d94-abb0-eae12617d536 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.622047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.622876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.623351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.623740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.624544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:07.624949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.626510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.643826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 295/592] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.644949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.651790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf67110-fd53-4fec-ac6c-8f25db108c46 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.677418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.698522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.699298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.699775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.700178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.711740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.713368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:07.729880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:07.731030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:07.732175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:07.732175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:07.732175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:07.737952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 298/593] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:07.737952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.770142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.780970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fc5db-6a36-4b41-aa0b-815e22fbc769 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.817327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.818115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.818510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.818884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.838332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.839957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:07.852609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:07.853600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:07.854815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:07.859060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 296/594] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:07.859921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.869573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa98d0-be87-4381-ac3e-8d68ce8b1faa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.915243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.916809 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.917318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.918073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.928857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.930899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:07.948085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:07.949026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:07.949925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:07.952574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 299/595] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:07.953491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.977912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525b73e-f938-4fb4-b290-43b19ca2df5a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.998815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.030091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.031406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.031866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.032542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.033585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:08.034045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.036950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.058966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 297/596] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.058966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.079538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.089608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666b9bd-c0ad-43da-bdec-98881e68a41a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.128181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.128791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.129627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.130096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.130939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:08.131246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.132825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.156236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 300/597] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.156236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.174378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113cb0-eb5a-4fdd-be24-e8a9934ecfab None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.208995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588c62d-ec81-4255-ac2e-bc51014725de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.209536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588c62d-ec81-4255-ac2e-bc51014725de None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.209819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588c62d-ec81-4255-ac2e-bc51014725de None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.210093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588c62d-ec81-4255-ac2e-bc51014725de None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.210791 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588c62d-ec81-4255-ac2e-bc51014725de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:08.211099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588c62d-ec81-4255-ac2e-bc51014725de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.212571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588c62d-ec81-4255-ac2e-bc51014725de None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.224498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 298/598] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.225666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d8d2-c88b-48d2-b84b-7b9750264dd4 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.225955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d8d2-c88b-48d2-b84b-7b9750264dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.226234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86d8d2-c88b-48d2-b84b-7b9750264dd4 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.231898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 299/599] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:08.231898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86d8d2-c88b-48d2-b84b-7b9750264dd4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.254337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.267552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6552e-832c-4884-8ab9-82a39cb224b6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.303239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.303898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.304183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.304457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.307960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.311378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.312845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:08.324349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:08.325246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 301/600] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:08.326152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.346727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86d8d2-c88b-48d2-b84b-7b9750264dd4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.384600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10582db1-19ab-4aa3-8fa3-453e398b64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.385248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10582db1-19ab-4aa3-8fa3-453e398b64bb None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.385584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10582db1-19ab-4aa3-8fa3-453e398b64bb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.385863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10582db1-19ab-4aa3-8fa3-453e398b64bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.397482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10582db1-19ab-4aa3-8fa3-453e398b64bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.399210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10582db1-19ab-4aa3-8fa3-453e398b64bb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-10582db1-19ab-4aa3-8fa3-453e398b64bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:08.414809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:08.415830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:08.421659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:08.421659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:08.421659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:08.421659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 300/601] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:08.421659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4960e-4526-4e2a-95cd-4e93154e080b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.421659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4960e-4526-4e2a-95cd-4e93154e080b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.421659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4960e-4526-4e2a-95cd-4e93154e080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.435649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23c917-e91c-492b-97a9-8898e15e2f1c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.437281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-41e4960e-4526-4e2a-95cd-4e93154e080b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:08.438601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-41e4960e-4526-4e2a-95cd-4e93154e080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:08.471095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.471690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.472044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.472274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/009c623055dc4defa2bd74a82c6a7e43/roles/9c4b8b10d69d46b8aa4ecc21408597f2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.491335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=009c623055dc4defa2bd74a82c6a7e43, role_id=9c4b8b10d69d46b8aa4ecc21408597f2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.492808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.501680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.508422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 302/602] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:08 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/009c623055dc4defa2bd74a82c6a7e43/roles/9c4b8b10d69d46b8aa4ecc21408597f2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:08.509661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.514498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 301/603] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:08.515737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4960e-4526-4e2a-95cd-4e93154e080b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.599930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.673613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4960e-4526-4e2a-95cd-4e93154e080b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.703309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5814801-c537-4c9e-8ee2-98c1473f7782 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.711549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.712205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.712489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.712767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.713434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:08.713742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.715126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.728771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 302/604] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.735206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.747392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.749022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.749309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.749582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.750846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:08.751427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.753125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.770630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 303/605] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.776498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.858391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd5819-0a1e-47ac-9096-bb1e7381afdc None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.868650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.873953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.896081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e316710-5984-4130-8887-70d2d337af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.896732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e316710-5984-4130-8887-70d2d337af9d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.897019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e316710-5984-4130-8887-70d2d337af9d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.897298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e316710-5984-4130-8887-70d2d337af9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.904457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e316710-5984-4130-8887-70d2d337af9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.905919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e316710-5984-4130-8887-70d2d337af9d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.917795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df990cd5-722e-48fb-835a-d4e3950ae8a9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1e316710-5984-4130-8887-70d2d337af9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:08.918389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:08.919265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 303/606] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:08.920777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560264c1-b15d-45f9-83cb-6ce2c2c93479 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.921341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560264c1-b15d-45f9-83cb-6ce2c2c93479 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.921341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560264c1-b15d-45f9-83cb-6ce2c2c93479 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.922479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 304/607] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:08.923015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560264c1-b15d-45f9-83cb-6ce2c2c93479 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.961176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.961977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.962425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.962921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/3474a82d27d04dcc9b9818608b00fb48/roles/9c4b8b10d69d46b8aa4ecc21408597f2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.979986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=3474a82d27d04dcc9b9818608b00fb48, role_id=9c4b8b10d69d46b8aa4ecc21408597f2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.981344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.005670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 304/608] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:08 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/3474a82d27d04dcc9b9818608b00fb48/roles/9c4b8b10d69d46b8aa4ecc21408597f2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:03:09.005670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.064479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560264c1-b15d-45f9-83cb-6ce2c2c93479 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.110541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6987d1-27ec-4e63-ad07-72a224462e1e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.120267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed3dbf-db52-4c2e-aa96-64fdca296ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.121030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3dbf-db52-4c2e-aa96-64fdca296ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.121443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3dbf-db52-4c2e-aa96-64fdca296ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.122136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3dbf-db52-4c2e-aa96-64fdca296ec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.128185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.139343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed3dbf-db52-4c2e-aa96-64fdca296ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-9eed3dbf-db52-4c2e-aa96-64fdca296ec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:09.148435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:09.149693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:09.150601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 305/609] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:09.152483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96c9-05bb-404e-b20d-4ec0a1ad228c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.155833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96c9-05bb-404e-b20d-4ec0a1ad228c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.155833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96c9-05bb-404e-b20d-4ec0a1ad228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.156058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.156709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.157251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.157622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.158431 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:09.158839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.161163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.175286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e58c96c9-05bb-404e-b20d-4ec0a1ad228c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:09.177139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e58c96c9-05bb-404e-b20d-4ec0a1ad228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:09.179912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 305/610] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:09.180878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.217136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.275982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 306/611] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:09.276787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c96c9-05bb-404e-b20d-4ec0a1ad228c None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.324420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e3170-3329-4e14-a483-1faf7b632ada None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.391579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.392574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.393096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.393553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.394501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:09.395573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.397131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.398323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c96c9-05bb-404e-b20d-4ec0a1ad228c None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.419535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 306/612] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:09.423819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.464144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.471040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.471722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.472046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.472311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/13729a757e1a4f95a957fedb84705960/roles/9c4b8b10d69d46b8aa4ecc21408597f2` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.506866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=13729a757e1a4f95a957fedb84705960, role_id=9c4b8b10d69d46b8aa4ecc21408597f2)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.508843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.531456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 307/613] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:09 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/13729a757e1a4f95a957fedb84705960/roles/9c4b8b10d69d46b8aa4ecc21408597f2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:09.581697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c1fca-0ef9-4600-a53c-7fac2031f267 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.620798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.621450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.621729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.622000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.634967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.636462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.638725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:09.665276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:09.666314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:09.667214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:09.667214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:09.667214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:09.669597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 307/614] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:09.670016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.673718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.788618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad4cc-4fdd-4cc2-a4c6-d20e5bbcbc00 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.789286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.817229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8e359-4e8b-4e56-8fdc-a1c8f60bbcb3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.849031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.849733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.850020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.850299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.872519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:09.878756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:09.879921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:09.880801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:09.881908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 308/615] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:09.888484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.889470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.890093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.890373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.890648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.891305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:09.891612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.893008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.920088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 308/616] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:09.924930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.030087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.072923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902593-bf58-4178-9828-6d6958fd64a5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.084268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd0263-2465-4b27-a54e-7e8ec3abcf44 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.121230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.121888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.122175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.122454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.131030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.132499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.145308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.145699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.151365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.151365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.151365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:10.151365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.151365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:10.151755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:10.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:10.153571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 309/617] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:10.163645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.166500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.177488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 309/618] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:10.183797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.330939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470f9b7-c955-4d6f-bb80-bdc8f696bbf0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.388728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14afe40-2af7-44de-9317-7589b5e62f47 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.404724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.405348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.405631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.405910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.406649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:10.406960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.408429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.446561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.449562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.450016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 310/619] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:10.450509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.450978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.456694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.463222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.479481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.481132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:10.506531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:10.507890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:10.509021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:10.509021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:10.509021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:10.512044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 310/620] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:10.518268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.572285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.652994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359169f3-b4a5-4a84-83fd-93b760008997 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.704288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d104269-210e-48ff-a338-08dded9cab18 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.733433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d48517-f33b-4f21-aeba-2e45636f9cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.734087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d48517-f33b-4f21-aeba-2e45636f9cfa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.734370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d48517-f33b-4f21-aeba-2e45636f9cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.734644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d48517-f33b-4f21-aeba-2e45636f9cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.752616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d48517-f33b-4f21-aeba-2e45636f9cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.756547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d48517-f33b-4f21-aeba-2e45636f9cfa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.770086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dcda2-42dd-4c1f-9270-030b3024cc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.770937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dcda2-42dd-4c1f-9270-030b3024cc63 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.771418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dcda2-42dd-4c1f-9270-030b3024cc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.771867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dcda2-42dd-4c1f-9270-030b3024cc63 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.772710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dcda2-42dd-4c1f-9270-030b3024cc63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:10.773181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dcda2-42dd-4c1f-9270-030b3024cc63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-51d48517-f33b-4f21-aeba-2e45636f9cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:10.773647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:10.774680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:10.775736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:10.775736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:10.775736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:10.775736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 311/621] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:10.776356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50c2b-3c36-4100-832c-003f86f6a869 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.776641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50c2b-3c36-4100-832c-003f86f6a869 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.777009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50c2b-3c36-4100-832c-003f86f6a869 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.777752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dcda2-42dd-4c1f-9270-030b3024cc63 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.778520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 312/622] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:10.785653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50c2b-3c36-4100-832c-003f86f6a869 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.795631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 311/623] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:10.796977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c20345-a93b-4d22-bfc2-ccc0e054affe None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.797280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c20345-a93b-4d22-bfc2-ccc0e054affe None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.797553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c20345-a93b-4d22-bfc2-ccc0e054affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.822240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-84c20345-a93b-4d22-bfc2-ccc0e054affe None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:10.822240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-84c20345-a93b-4d22-bfc2-ccc0e054affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:10.887048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.913919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 312/624] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:10.915309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c20345-a93b-4d22-bfc2-ccc0e054affe None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.918530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf50c2b-3c36-4100-832c-003f86f6a869 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.932728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.976778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.978225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.979305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.980165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.982034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:10.982967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.984760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.026513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 313/625] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:11.029441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.071302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c20345-a93b-4d22-bfc2-ccc0e054affe None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.122633 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.124150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.124636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.125128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.136631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.140104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:11.157937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:11.158960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:11.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:11.167850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 313/626] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:11.170229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.227788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.255885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32865bb-9676-47b7-b762-e66c5df87e31 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.296246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ff29-1de6-4009-bf30-4c361532df53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.296891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ff29-1de6-4009-bf30-4c361532df53 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.297165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ff29-1de6-4009-bf30-4c361532df53 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.297437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ff29-1de6-4009-bf30-4c361532df53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.305792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ff29-1de6-4009-bf30-4c361532df53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.308396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ff29-1de6-4009-bf30-4c361532df53 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5134ff29-1de6-4009-bf30-4c361532df53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:11.322550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:11.323568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:11.324579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:11.327058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 314/627] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:11.327058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d966c1-368d-4397-b5d9-19eb0f5a7a72 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.327058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d966c1-368d-4397-b5d9-19eb0f5a7a72 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.327058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d966c1-368d-4397-b5d9-19eb0f5a7a72 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.328731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 315/628] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:11.339119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b352-d523-4285-a396-4757ec4398f2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.339619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b352-d523-4285-a396-4757ec4398f2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.340118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b352-d523-4285-a396-4757ec4398f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.349298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38eb72-61f3-47f5-8e7e-e7ea7b2c3829 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.368836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-43c3b352-d523-4285-a396-4757ec4398f2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:11.371789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-43c3b352-d523-4285-a396-4757ec4398f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:11.398395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.399030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.399355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.399874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.401276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:11.401746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.403694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.411477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.424915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 314/629] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:11.426502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.469065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 316/630] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:11.473579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3b352-d523-4285-a396-4757ec4398f2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.561167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.570433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad9d5f-226d-4ae8-bc7b-bbda06a4a8fb None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.620319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.621188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.621641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.622052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.622816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3b352-d523-4285-a396-4757ec4398f2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.623057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:11.623501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.625259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.640310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 315/631] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:11.641504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.666275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.667079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.667383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.667723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.682833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:11.688551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:11.689492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:11.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:11.695046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 317/632] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:11.695994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.727796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.782930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd1282-7e98-4147-821a-be3079c0ec94 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.826889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.827509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.827788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.828090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.838167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af4672-c4f5-4da0-8444-be45459e0779 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.859239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.886321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.886995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.887273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.887551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/52a56e6519a04ac297ef8f2e1094157f/roles/9c4b8b10d69d46b8aa4ecc21408597f2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.902406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=52a56e6519a04ac297ef8f2e1094157f, role_id=9c4b8b10d69d46b8aa4ecc21408597f2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.903952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.905399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.906866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.917398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 318/633] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:11 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/52a56e6519a04ac297ef8f2e1094157f/roles/9c4b8b10d69d46b8aa4ecc21408597f2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:11.918212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.000840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.032175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 316/634] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:12.032175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.043283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92abc7-c5f6-40e3-a33f-058a9e80063a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.086189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68d68c-56ba-44b8-a024-9247b4ccc8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.086813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d68c-56ba-44b8-a024-9247b4ccc8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.087094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d68c-56ba-44b8-a024-9247b4ccc8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.087369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d68c-56ba-44b8-a024-9247b4ccc8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.088104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68d68c-56ba-44b8-a024-9247b4ccc8c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:12.088408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68d68c-56ba-44b8-a024-9247b4ccc8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.089764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68d68c-56ba-44b8-a024-9247b4ccc8c1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.095706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.103838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 319/635] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:12.103838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3fbf5-2775-4f2e-85c0-780a3277396a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.103838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3fbf5-2775-4f2e-85c0-780a3277396a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.103838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3fbf5-2775-4f2e-85c0-780a3277396a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.103838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 320/636] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:12.103838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3fbf5-2775-4f2e-85c0-780a3277396a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.153328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f354-b295-4d08-a654-2dec68863f89 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.193194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.194083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.194676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.195106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.210514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:12.211392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3fbf5-2775-4f2e-85c0-780a3277396a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:12.216118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:12.217244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:12.218296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:12.223973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 317/637] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:12.224867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.251164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82fc75-f3de-4fe2-8d09-731b68afd7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.251738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82fc75-f3de-4fe2-8d09-731b68afd7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.252069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82fc75-f3de-4fe2-8d09-731b68afd7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.252612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82fc75-f3de-4fe2-8d09-731b68afd7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.254508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.265131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82fc75-f3de-4fe2-8d09-731b68afd7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.266164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82fc75-f3de-4fe2-8d09-731b68afd7f2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3a82fc75-f3de-4fe2-8d09-731b68afd7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:12.281118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:12.282097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:12.282994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:12.282994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:12.282994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:12.282994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 321/638] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:12.283993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005d513-3dcf-40c8-aa97-be3af4e7f28b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.283993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005d513-3dcf-40c8-aa97-be3af4e7f28b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.284155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005d513-3dcf-40c8-aa97-be3af4e7f28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.303042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3005d513-3dcf-40c8-aa97-be3af4e7f28b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:12.304291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3005d513-3dcf-40c8-aa97-be3af4e7f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:12.341680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e953086-05d3-4f5c-9553-83a3528033fc None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.360132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.380786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.381438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.381799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.382016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.384017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 322/639] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:12.390351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005d513-3dcf-40c8-aa97-be3af4e7f28b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.393091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.394650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:12.410105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:12.411125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:12.412050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:12.412050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:12.412050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:12.416103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 318/640] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:12.416977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.523720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccd52b-f467-41de-8732-49dffd170f23 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.534283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005d513-3dcf-40c8-aa97-be3af4e7f28b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.558448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.567280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.567989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.568238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.568516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.569178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:12.569488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.570876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.584870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.585768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.586248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.586735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.587597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:12.588071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 319/641] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:12.588416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.588943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.590331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.602426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 323/642] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:12.603518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.624349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.713228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d5483-2871-4cae-aa06-a7ea95289b9e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.717364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648fc7-3be5-480f-bd1b-9ab7ba5634d7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.751431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.752238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.752587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.752835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.753054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.753467 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.753750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.754030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:12.754122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.754542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.756024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.761059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.762492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.772920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 320/643] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:12.772920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:12.778800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:12.779908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:12.780826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 324/644] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:12.781311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.824494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.876916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.890675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7735d23-ca56-4cfc-b9d0-d9e8b0558848 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.896084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add0cdf-2342-4bbd-8015-fd73e56fbaf7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.927987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.928630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.928901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.929182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.934349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.935243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.935726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.936363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.939844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.941864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.948710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:12.954178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:12.955085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:12.956437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:12.957736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:12.960166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:12.962257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:12.962257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:12.962257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:12.962649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 325/645] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:12.962649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.962927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 321/646] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:12.963503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.072277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c447fa0-0fc4-4115-8175-c6a61ea7a978 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.075322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.079427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da9d3-cf77-407c-8bd9-47efc158cc24 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.108117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.108729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.109012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.109287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.109981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.110287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.111729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.123306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.124271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.124713 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.125148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.125726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.130260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 322/647] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.131409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.138747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.140226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:13.152145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:13.153156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 326/648] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:13.154552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.245090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef857-084a-423f-9ace-f752673901e5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.263074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def5f87-fd30-437f-af6f-b666e2fa6750 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.281739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.282358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.282642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.282972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.283720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.284058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.285491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.297451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 323/649] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.298068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.304278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.304902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.305185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.305460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.306129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.306434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.307789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.321804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 327/650] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.321804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.344645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.362480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.408844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353ca05-e1fd-450a-8c2f-21c1f24cd5d2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.429019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b6e17-9c8f-4405-aa09-1f577710204f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.449001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.449631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.449941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.450220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.450948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=352b7e4d311d491f8e665d4cf7e554b8) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.451258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.452856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.463843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 324/651] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/role_assignments?user.id=352b7e4d311d491f8e665d4cf7e554b8&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.463843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.478815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.480016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.480409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.480755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.481598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.481986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.483659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.509868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 328/652] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.510981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.592239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb851-afb2-4e04-9e74-8bd29c22c9a1 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.615852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.630622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.645295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345091-11bc-4e87-bffc-984ab6b8a9f9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.646278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.647010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.647366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.647720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.657138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.658780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:13.676587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:13.677576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 325/653] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:13.680457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.707269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.707931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.708215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.708486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.723315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.725049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:13.747877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:13.749039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:13.750135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:13.750135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:13.750135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:13.750135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 329/654] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:13.750135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.811243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2326a-04e9-4617-8ff8-f2048faf2424 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.861056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32529-d835-4364-a4e2-c42720cd93f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.862202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32529-d835-4364-a4e2-c42720cd93f2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.862652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32529-d835-4364-a4e2-c42720cd93f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.863082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32529-d835-4364-a4e2-c42720cd93f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.885485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b096512-8c9f-4230-bbf7-5caf24d94461 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.918007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.921789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.924263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.924888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.925161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.925435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.926804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.927111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.928555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.942732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32529-d835-4364-a4e2-c42720cd93f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.945343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32529-d835-4364-a4e2-c42720cd93f2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.946662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 330/655] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.947497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.055761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 326/656] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:14.056132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36866aec-f2a2-48d3-841c-8b8bd425a265 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.057322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835413d8-a7f0-41ec-830f-60f9bc8d4641 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.057683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835413d8-a7f0-41ec-830f-60f9bc8d4641 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.058060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835413d8-a7f0-41ec-830f-60f9bc8d4641 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.063346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 327/657] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:14.063346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835413d8-a7f0-41ec-830f-60f9bc8d4641 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.100640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.101261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.101540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.101817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.102474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:14.102786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.104480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.116524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 331/658] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:14.117171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.161795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.173906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.181819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835413d8-a7f0-41ec-830f-60f9bc8d4641 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.222723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.223331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.223613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.223928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.230807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3926d-a58c-4510-8d63-354c1fe4ecd7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.264918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f16b41-adc3-4d57-b3ad-be4d14aa098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.265546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16b41-adc3-4d57-b3ad-be4d14aa098d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.265821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16b41-adc3-4d57-b3ad-be4d14aa098d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.266094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f16b41-adc3-4d57-b3ad-be4d14aa098d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.278170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f16b41-adc3-4d57-b3ad-be4d14aa098d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.279619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f16b41-adc3-4d57-b3ad-be4d14aa098d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-60f16b41-adc3-4d57-b3ad-be4d14aa098d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:14.294596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:14.295595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:14.296826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:14.296826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:14.296826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:14.300359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 332/659] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:14.300477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.301917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1551-e911-43f5-8bbe-a5b684cfdf13 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.302205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1551-e911-43f5-8bbe-a5b684cfdf13 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.302479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d1551-e911-43f5-8bbe-a5b684cfdf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.302942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.320061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b32d1551-e911-43f5-8bbe-a5b684cfdf13 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:14.321250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b32d1551-e911-43f5-8bbe-a5b684cfdf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:14.392059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.396000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 333/660] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:14.396000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d1551-e911-43f5-8bbe-a5b684cfdf13 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.421206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 328/661] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:14.421896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.433884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.515695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d1551-e911-43f5-8bbe-a5b684cfdf13 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.557023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.557689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.557970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.558249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.567181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.568475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.573398 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ba7e-d3f2-4da4-958a-10bba54ba93a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:14.581378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:14.584250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:14.586038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:14.587856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 334/662] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:14.588674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.641964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.643648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.646088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.647078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.648671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:14.649311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.652200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.679402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 329/663] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:14.681178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.703218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.726056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdf49-4515-4a3b-a7bf-6b56796d70f5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.752642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.805176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.805983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.806261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.806531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.818183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.819626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.820910 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed45a-df5a-47da-9276-028cb8a29fa6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:14.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:14.836059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:14.837135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:14.837135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:14.837135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:14.840143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 335/664] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:14.840745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.869571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.870926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.871514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.872063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.873402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:14.874205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.875842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.898826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 330/665] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:14.898826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.949740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21d706-3f67-4e40-8376-588fb4866aa9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.986149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.987020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.987298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.987573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.995997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.997665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.004668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a218610-e67c-4c42-904e-e2fd32c04e26 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.006603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:15.009599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:15.010505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:15.011782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 336/666] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:15.012567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.018533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.052093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.052739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.053020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.053293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.063943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:15.068824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:15.069765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:15.070591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 331/667] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:15.071314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.129149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab1306-811a-410a-b2e8-3692460b912c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.163436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.164077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.164373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.164650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.165281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:15.165586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.166945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.179272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 337/668] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:15.180117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.188424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bba675-5670-4ad0-a942-ad22ec71bce6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.225013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.225556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.225838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.226116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.247693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.259449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.292440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649109c-206e-4367-b448-a7f6643ea572 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.301012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.303124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.329363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.329986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.330279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.330532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.331223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:15.331524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.333724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.345077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 338/669] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:15.345996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.421262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 332/670] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:15.422506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.460598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64e8f1-7db4-49cc-99e5-1c9bc24c4880 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.486174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.487244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.500122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.500965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.501250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.501520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.502306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:15.502665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.504237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.517978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 339/671] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:15.518838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.528361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ddf8-42aa-4db7-bf4d-91378bba72ee None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.563728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.564522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.564871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.565151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.572091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.573537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:15.585283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:15.586349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 333/672] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:15.592099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.631867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9449-e246-4c20-9d04-4acf069339e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.665588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.666199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.666463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.666732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.667448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=009c623055dc4defa2bd74a82c6a7e43) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:15.667753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.669199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.675030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 340/673] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/role_assignments?user.id=009c623055dc4defa2bd74a82c6a7e43&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:15.675942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.687474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cb630-6b8f-4f15-bdd8-92f1601873b9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.716757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.731753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e61e52-4e93-4570-bc92-3387ade1355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.732448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61e52-4e93-4570-bc92-3387ade1355f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.732731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61e52-4e93-4570-bc92-3387ade1355f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.733011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e61e52-4e93-4570-bc92-3387ade1355f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.733684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.745381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e61e52-4e93-4570-bc92-3387ade1355f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.746723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e61e52-4e93-4570-bc92-3387ade1355f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-34e61e52-4e93-4570-bc92-3387ade1355f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:15.763708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:15.764934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:15.766285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:15.766285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:15.766285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:15.768171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 334/674] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:15.770997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f187c-a995-42f1-ab13-e5515a941f60 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.771287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f187c-a995-42f1-ab13-e5515a941f60 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.771564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f187c-a995-42f1-ab13-e5515a941f60 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.773449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 335/675] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:15.777013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f187c-a995-42f1-ab13-e5515a941f60 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.796703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc4da1-768c-428b-8778-c90c9d130436 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.838493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.839183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.839600 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.839964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.852253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.853761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:15.873261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:15.874262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:15.875170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:15.875170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:15.875170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:15.875170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 341/676] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:15.875855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.899022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f187c-a995-42f1-ab13-e5515a941f60 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.935498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa2abf-4f2d-4b75-856f-c23e5249566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.936467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2abf-4f2d-4b75-856f-c23e5249566d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.936934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2abf-4f2d-4b75-856f-c23e5249566d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.937405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa2abf-4f2d-4b75-856f-c23e5249566d None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.938478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa2abf-4f2d-4b75-856f-c23e5249566d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:15.938796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa2abf-4f2d-4b75-856f-c23e5249566d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.940289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa2abf-4f2d-4b75-856f-c23e5249566d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.959190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 336/677] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:15.959190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9334-140a-4a3e-8673-567d473b3b37 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.959190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9334-140a-4a3e-8673-567d473b3b37 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.959190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec9334-140a-4a3e-8673-567d473b3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.975565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-caec9334-140a-4a3e-8673-567d473b3b37 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:15.976932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-caec9334-140a-4a3e-8673-567d473b3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:15.983957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.987358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282e627-d17a-4346-8442-17c1540e4f4b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.009974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.025729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.026343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.026619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.026932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.027578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:16.027986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.029346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.042618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 342/678] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.043519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.059841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 337/679] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:16.060967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec9334-140a-4a3e-8673-567d473b3b37 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.172486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be738770-1d85-4500-a845-507bb0237c17 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.177452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec9334-140a-4a3e-8673-567d473b3b37 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.213290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.213819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.213942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.214172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.214447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.215178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=3474a82d27d04dcc9b9818608b00fb48) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:16.215377 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.215485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.215989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.216476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.217044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.217535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:16.218033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.219845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.224023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 338/680] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/role_assignments?user.id=3474a82d27d04dcc9b9818608b00fb48&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.224938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.238960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 343/681] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.240430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.256869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.270184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.400003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5db92-be47-40b7-94ae-1706bfc65776 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.421754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ecb4c-bf6d-471a-b257-3e3bf841158d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.445542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.446184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.446461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.446725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.457107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.458772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:16.471955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:16.473489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:16.474394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 339/682] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:16.474946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.477700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.478495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.479141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.479490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.487777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.489950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:16.501777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:16.502718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 344/683] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:16.504735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.599354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.604311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.614297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ef64d-ea0f-4cae-adde-6584798c1b77 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.633767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991a5d-1829-4dee-964f-318baba53e80 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.655441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.656350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.656814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.657759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.672442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:16.672598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.673315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.673695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.674063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.674874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:16.675280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.677097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:16.679418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:16.680554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:16.681594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:16.684474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 340/684] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:16.685416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.703261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 345/685] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.703261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.818438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1d29a-9556-4039-a637-2e83802bac1a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.822953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b531a7-bc34-4604-a61e-e3e9bb3b3488 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.865138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.865831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.866106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.866380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.867182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:16.867491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.869040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.869369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.870173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.870602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.871379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.873290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:16.873771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.875332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.888271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 346/686] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.893748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.893895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 341/687] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.893895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.897128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.905571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.021376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a484a-2697-4d8f-8a46-e788375266f7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.024946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dd649-37ed-4617-818c-10a93d7ce703 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.067785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.068430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.068708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.068981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.070117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.071232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.072138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.072629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.073564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=13729a757e1a4f95a957fedb84705960) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:17.074076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.076237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.079546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.081007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.085689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 347/688] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/role_assignments?user.id=13729a757e1a4f95a957fedb84705960&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:17.086807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:17.112715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:17.113837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:17.114743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:17.114743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:17.114743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:17.116089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 342/689] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:17.125340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.231267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.252850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.287755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab606f-c1ec-4d8e-8159-1ead21dd2cba None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.309134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68c64a-6f47-4551-ada4-3e367661f00f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.329142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.330180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.330684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.331157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.358851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.359843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.360337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.360818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.361679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:17.362185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.364012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.377047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 343/690] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:17.384199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.423477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.424999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.506308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931d851-7ac9-4605-a4b4-4e9a341b0516 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.515306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.531954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.569514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.570699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.571974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.573067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.582971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 348/691] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:17.587716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.588886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.592452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:17.615400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:17.616444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:17.617393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:17.622006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 344/692] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:17.627683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.798242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c266f92-e090-4987-afe8-2fb79a106328 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.802419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389f11-736a-474e-86b0-e6885ba4db99 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.842742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.843388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.843671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.844062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.847510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83549f21-8ec7-4c19-bbc4-f1c614f00d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.848424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549f21-8ec7-4c19-bbc4-f1c614f00d10 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.848912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549f21-8ec7-4c19-bbc4-f1c614f00d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.849384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549f21-8ec7-4c19-bbc4-f1c614f00d10 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.850331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549f21-8ec7-4c19-bbc4-f1c614f00d10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:17.850855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549f21-8ec7-4c19-bbc4-f1c614f00d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.852723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549f21-8ec7-4c19-bbc4-f1c614f00d10 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.859882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.859882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:17.872499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:17.873486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:17.874752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:17.874752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:17.874752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:17.874752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 349/693] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:17.884212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.888827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 345/694] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:17.892282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cdc33-b8df-47e5-8bd9-d99416750bb6 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.892920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cdc33-b8df-47e5-8bd9-d99416750bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.893405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cdc33-b8df-47e5-8bd9-d99416750bb6 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.895841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 346/695] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:17.896899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cdc33-b8df-47e5-8bd9-d99416750bb6 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.907338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.943962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.993665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a87e5f-dea4-4535-9f51-ce0e73ff6f75 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.023564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cdc33-b8df-47e5-8bd9-d99416750bb6 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.028743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573daf27-dff8-45e3-a6a5-b2e159f5c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.029378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573daf27-dff8-45e3-a6a5-b2e159f5c902 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.029646 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573daf27-dff8-45e3-a6a5-b2e159f5c902 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.029923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573daf27-dff8-45e3-a6a5-b2e159f5c902 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.030570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573daf27-dff8-45e3-a6a5-b2e159f5c902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:18.031061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573daf27-dff8-45e3-a6a5-b2e159f5c902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.032457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573daf27-dff8-45e3-a6a5-b2e159f5c902 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.050011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 350/696] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:18.052023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad437d-7c3d-4485-9bf4-73fa55b8b437 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.052309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad437d-7c3d-4485-9bf4-73fa55b8b437 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.052589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad437d-7c3d-4485-9bf4-73fa55b8b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.069317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.069946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.070243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.070509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.072146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-72ad437d-7c3d-4485-9bf4-73fa55b8b437 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:18.073654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-72ad437d-7c3d-4485-9bf4-73fa55b8b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:18.155995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 351/697] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:18.157205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad437d-7c3d-4485-9bf4-73fa55b8b437 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.163835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.164113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.178841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.206728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.288001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 347/698] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:18.293399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.348413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad437d-7c3d-4485-9bf4-73fa55b8b437 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.388970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01ae4-e22d-425d-acee-19623de39032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.389607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01ae4-e22d-425d-acee-19623de39032 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.389888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01ae4-e22d-425d-acee-19623de39032 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.390164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01ae4-e22d-425d-acee-19623de39032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.397421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b01ae4-e22d-425d-acee-19623de39032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.398880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b01ae4-e22d-425d-acee-19623de39032 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-54b01ae4-e22d-425d-acee-19623de39032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:18.411324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:18.412336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:18.413252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:18.417227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 352/699] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:18.418540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23ecd-d700-4581-a6c8-f09c98064699 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.418765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23ecd-d700-4581-a6c8-f09c98064699 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.419039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb23ecd-d700-4581-a6c8-f09c98064699 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.420323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 353/700] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:18.420999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23ecd-d700-4581-a6c8-f09c98064699 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.428161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168ea71-0841-46e1-bef1-382f0ba0ce52 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.474156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0979b90-33a1-433f-95b8-cf946dcbab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.475110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979b90-33a1-433f-95b8-cf946dcbab41 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.475573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979b90-33a1-433f-95b8-cf946dcbab41 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.476050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0979b90-33a1-433f-95b8-cf946dcbab41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.480013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.490935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0979b90-33a1-433f-95b8-cf946dcbab41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.492568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0979b90-33a1-433f-95b8-cf946dcbab41 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.498456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-d0979b90-33a1-433f-95b8-cf946dcbab41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:18.510538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:18.512201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:18.513348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:18.513348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:18.513348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:18.513348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 348/701] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:18.513348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370a0e-265c-4ae1-a3c7-ce141681fa7b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.513648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370a0e-265c-4ae1-a3c7-ce141681fa7b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.513914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370a0e-265c-4ae1-a3c7-ce141681fa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.532714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-0a370a0e-265c-4ae1-a3c7-ce141681fa7b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:18.533873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb23ecd-d700-4581-a6c8-f09c98064699 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.533984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0a370a0e-265c-4ae1-a3c7-ce141681fa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:18.571712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.572364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.572640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.572914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.573606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:18.573913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.575326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.587522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 354/702] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:18.588401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.615539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 349/703] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:18.616740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a370a0e-265c-4ae1-a3c7-ce141681fa7b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.710233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bfbe5-cf6f-462c-8680-bc448c4a3072 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.716906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a370a0e-265c-4ae1-a3c7-ce141681fa7b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.735371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.741280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.751223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.751890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.752239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.752522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.755458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.756309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.756779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.757226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.758053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:18.758548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.760110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.764300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.765723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.773013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 350/704] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:18.774123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:18.781487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:18.782452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:18.783632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:18.783632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:18.783632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:18.787995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 355/705] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:18.788909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.895073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00a9a0-994b-41bf-ba86-ac3b391c04f9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.902226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a763-4ba5-416c-b0a8-ff4ec4ad4252 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.932270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.932879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.933160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.933432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.934156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=52a56e6519a04ac297ef8f2e1094157f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:18.934461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.935940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.938676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.939308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.939588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.939883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.943854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 351/706] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/role_assignments?user.id=52a56e6519a04ac297ef8f2e1094157f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:18.943854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.953279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.955176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:18.969261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:18.970225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:18.971131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:18.974873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 356/707] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:18.976087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.998856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.029331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.066178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a322a9a-41db-4f8f-ba8c-dd5d59efcf1b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.105883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363deb9-fe2b-4e2d-94dc-884a268565da None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.117855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.118569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.119248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.119528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.120220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.120681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.122344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.139298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 352/708] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.140560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.153628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.153628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.154023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.156486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.156486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.156810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:19.170449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:19.171554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:19.172484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 357/709] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:19.173315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.272191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bc114-26e2-49e8-8751-aef26dddfa1d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.273641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.291360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78228e1d-0b57-409a-9099-acadcf4a73a7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.294566 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.313254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.313878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.314157 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.314428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.315473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.315583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.317614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.330897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.331103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 353/710] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.331951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.332330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.332952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.333439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.334366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.336091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.362496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 358/711] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:03:19 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:19.365410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.500037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58cf44-23cf-4cd7-a096-c426bcb17397 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.511040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5f192-58f3-431d-b1ac-8a84bd77c5b2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.543145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3ddd1-8c2c-4862-9942-8dfc0ea1d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.544055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ddd1-8c2c-4862-9942-8dfc0ea1d907 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.544343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ddd1-8c2c-4862-9942-8dfc0ea1d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.544624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3ddd1-8c2c-4862-9942-8dfc0ea1d907 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.545437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3ddd1-8c2c-4862-9942-8dfc0ea1d907 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.546078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3ddd1-8c2c-4862-9942-8dfc0ea1d907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.549719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3ddd1-8c2c-4862-9942-8dfc0ea1d907 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.555364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 354/712] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.556611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26edbd3-a5ce-4cb0-8281-ff1018086523 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.556952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26edbd3-a5ce-4cb0-8281-ff1018086523 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.557172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26edbd3-a5ce-4cb0-8281-ff1018086523 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.558617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 355/713] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:19.559160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cd106-44e8-4813-b2b4-01068cc5c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.559905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cd106-44e8-4813-b2b4-01068cc5c70d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.560280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cd106-44e8-4813-b2b4-01068cc5c70d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.560648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cd106-44e8-4813-b2b4-01068cc5c70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.561516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cd106-44e8-4813-b2b4-01068cc5c70d None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=316c09203d964b75a1da935349312a48, user.id=352b7e4d311d491f8e665d4cf7e554b8) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.561953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cd106-44e8-4813-b2b4-01068cc5c70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.563152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26edbd3-a5ce-4cb0-8281-ff1018086523 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.563559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cd106-44e8-4813-b2b4-01068cc5c70d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.571851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 359/714] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/role_assignments?user.id=352b7e4d311d491f8e665d4cf7e554b8&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.573417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ede8d4-4d09-4dce-ad24-6d68225687aa None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.573899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ede8d4-4d09-4dce-ad24-6d68225687aa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.574358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ede8d4-4d09-4dce-ad24-6d68225687aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.594551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-08ede8d4-4d09-4dce-ad24-6d68225687aa None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:19.596129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-08ede8d4-4d09-4dce-ad24-6d68225687aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:19.619224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.623927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.704116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 360/715] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:19.740217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26edbd3-a5ce-4cb0-8281-ff1018086523 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.778010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.778630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.778912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.779186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.779844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.780153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.781522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.788623 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 356/716] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.998164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ede8d4-4d09-4dce-ad24-6d68225687aa None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:20.126036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ede8d4-4d09-4dce-ad24-6d68225687aa None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:20.173490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:20.174145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:20.174434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:20.174711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:20.175305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:20.177172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:20.186563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:20.187564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:20.189480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 361/717] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:20.200941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:20.310687 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:20.321186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f0b65-9100-44a1-a538-30c3632dd197 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:20.364566 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb65f1f-82b0-48e5-9e28-3d144feb5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:20.365576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65f1f-82b0-48e5-9e28-3d144feb5516 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:20.366061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65f1f-82b0-48e5-9e28-3d144feb5516 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:20.366533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65f1f-82b0-48e5-9e28-3d144feb5516 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:20.367394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65f1f-82b0-48e5-9e28-3d144feb5516 None admin] RBAC: Adding query filter params (name=network) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:20.367937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65f1f-82b0-48e5-9e28-3d144feb5516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:20.369526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65f1f-82b0-48e5-9e28-3d144feb5516 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:20.380426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 357/718] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:20.385528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:20.418328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:20.532270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8ea17-e1bb-4fcc-aedd-09a222f1e1e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:20.581288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec756ad-960a-4657-818a-e1e1b84b934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:20.582046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec756ad-960a-4657-818a-e1e1b84b934e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:20.582330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec756ad-960a-4657-818a-e1e1b84b934e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:20.582603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec756ad-960a-4657-818a-e1e1b84b934e None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:20.583246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec756ad-960a-4657-818a-e1e1b84b934e None admin] RBAC: Adding query filter params (type=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:20.583552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec756ad-960a-4657-818a-e1e1b84b934e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:20.585038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec756ad-960a-4657-818a-e1e1b84b934e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:20.596711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 362/719] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:21.217901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371b50-ed24-48d4-8e68-995a728ded3a None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:21.218447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371b50-ed24-48d4-8e68-995a728ded3a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:21.218447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26371b50-ed24-48d4-8e68-995a728ded3a None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:21.220093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 358/720] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:21.225991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5d722-855a-4615-80b0-47e1add995a6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:21.226277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5d722-855a-4615-80b0-47e1add995a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:21.226550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5d722-855a-4615-80b0-47e1add995a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:21.251763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-67c5d722-855a-4615-80b0-47e1add995a6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:21.252976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-67c5d722-855a-4615-80b0-47e1add995a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:21.345547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 363/721] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:21.688737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371b50-ed24-48d4-8e68-995a728ded3a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:21.814255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26371b50-ed24-48d4-8e68-995a728ded3a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:21.862973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102bde3-ec85-4f35-8b4a-ff729c168d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:21.863618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102bde3-ec85-4f35-8b4a-ff729c168d12 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:21.863933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102bde3-ec85-4f35-8b4a-ff729c168d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:21.864210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102bde3-ec85-4f35-8b4a-ff729c168d12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:21.874834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102bde3-ec85-4f35-8b4a-ff729c168d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-5102bde3-ec85-4f35-8b4a-ff729c168d12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:21.880770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:21.881695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:21.882701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 359/722] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:21.887714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5d722-855a-4615-80b0-47e1add995a6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:21.911892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:21.915715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12cad-e8f4-44c3-ab1c-19031b63969e None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:21.916115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12cad-e8f4-44c3-ab1c-19031b63969e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:21.916455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f12cad-e8f4-44c3-ab1c-19031b63969e None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:21.917828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 360/723] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:21.923826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574207d0-1c2c-451a-bfce-1d0e281b7a1a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:21.924127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574207d0-1c2c-451a-bfce-1d0e281b7a1a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:21.924454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574207d0-1c2c-451a-bfce-1d0e281b7a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:21.944207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-574207d0-1c2c-451a-bfce-1d0e281b7a1a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:21.945335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-574207d0-1c2c-451a-bfce-1d0e281b7a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:21.956447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:22.084023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 361/724] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:22.091746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5d722-855a-4615-80b0-47e1add995a6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:22.147942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:22.148569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.148849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.149124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.149798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:22.150103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:22.151495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:22.160857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a7eee-559f-4a84-9cdc-49f4c7e9553c None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.161146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a7eee-559f-4a84-9cdc-49f4c7e9553c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.161420 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a7eee-559f-4a84-9cdc-49f4c7e9553c None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.163030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 362/725] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:22.167591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae4e1-1487-4760-810a-096c68db490b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.167909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae4e1-1487-4760-810a-096c68db490b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.168185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ae4e1-1487-4760-810a-096c68db490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.177969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 364/726] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:22.183848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:22.198914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-316ae4e1-1487-4760-810a-096c68db490b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:22.202847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-316ae4e1-1487-4760-810a-096c68db490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:22.312677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:22.312881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 363/727] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:22.314619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0339b59-1c78-429b-9058-8ae9ae304e21 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.315073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0339b59-1c78-429b-9058-8ae9ae304e21 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.315701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0339b59-1c78-429b-9058-8ae9ae304e21 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.318531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 364/728] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:22.324427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbcf4-de74-4ecd-baa8-7f7d87286274 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.324911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbcf4-de74-4ecd-baa8-7f7d87286274 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.325450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befbcf4-de74-4ecd-baa8-7f7d87286274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.344009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bde454-ee68-4a77-aa0b-c3dfbbf1f204 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:22.364598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7befbcf4-de74-4ecd-baa8-7f7d87286274 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:22.366695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7befbcf4-de74-4ecd-baa8-7f7d87286274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:22.406937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:22.407619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.407920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.408192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.427375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:22.429961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:22.454269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:22.455455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:22.457167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:22.457167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:22.457167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:22.459141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 365/729] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:22.460228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:22.482686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 365/730] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:22.483559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befbcf4-de74-4ecd-baa8-7f7d87286274 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:22.492314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:22.618150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd0c5f-afb3-414a-b754-59528b2c9fd9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:22.649550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:22.662045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:22.662691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.662978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.663668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.669729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befbcf4-de74-4ecd-baa8-7f7d87286274 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:22.676701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:22.683920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:22.684884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:22.685734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 366/731] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:22.686435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:22.716167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:22.717184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.717709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.718237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.719192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:22.719826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:22.721469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:22.738855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 366/732] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:22.739713 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:22.810552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58cf68-623b-4279-8615-df554c945142 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:22.815336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:22.848118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:22.848790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.849068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.849334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.860009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:22.864131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9b4b0-1ccf-4be5-bbdd-65ffefa75cb5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:22.866055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:22.867005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 367/733] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:22.869251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:22.901934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:22.902548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.902830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.903098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.903761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:22.904096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:22.905458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:22.918508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 367/734] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:22.918508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:22.924848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:22.985871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d04d96-0485-4e0b-a1bd-987c6c115a54 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.023147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c32f7-e72e-4302-a8ec-59fad31d4082 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.024634 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.025420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.025706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.026793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.036005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.038312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:23.049762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:23.051364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:23.052383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 368/735] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:23.053048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.058406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.072164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.073520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.074079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.074505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.075553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.077307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.095847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 368/736] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:22 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:23.095847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.180316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c5731-225b-40dd-b33b-70915596194d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.189185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.216298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9563cf5-9e94-4c3e-906f-6734821ec3ce None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.221514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.224735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.225063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.225347 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.226079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:23.226389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.227938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.237648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 369/737] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:23.239155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.259525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185734d-203e-4851-85b7-9c068b969c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.260210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185734d-203e-4851-85b7-9c068b969c46 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.260492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185734d-203e-4851-85b7-9c068b969c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.260776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185734d-203e-4851-85b7-9c068b969c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.272979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185734d-203e-4851-85b7-9c068b969c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.274454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185734d-203e-4851-85b7-9c068b969c46 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-d185734d-203e-4851-85b7-9c068b969c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:23.292371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:23.293531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:23.294637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:23.294637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.294637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:23.294637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 369/738] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:23.298964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c88d-8adc-4cd6-8b46-de95cb1625c5 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.298964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c88d-8adc-4cd6-8b46-de95cb1625c5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.298964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c88d-8adc-4cd6-8b46-de95cb1625c5 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.298964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 370/739] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:23.298964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c88d-8adc-4cd6-8b46-de95cb1625c5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.338922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.365439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec5dc4-56e8-4f52-9603-f131f129ac9f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.402921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41332-608a-4444-82c1-72add5865531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.403538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41332-608a-4444-82c1-72add5865531 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.403830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41332-608a-4444-82c1-72add5865531 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.404122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41332-608a-4444-82c1-72add5865531 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.404850 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae41332-608a-4444-82c1-72add5865531 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:23.405161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae41332-608a-4444-82c1-72add5865531 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.406629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae41332-608a-4444-82c1-72add5865531 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.413257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c88d-8adc-4cd6-8b46-de95cb1625c5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.428560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 370/740] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:23.432861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41332-608a-4444-82c1-72add5865531 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.451543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0785df6-4942-4557-aca8-d848bca79223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.452507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0785df6-4942-4557-aca8-d848bca79223 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.452790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0785df6-4942-4557-aca8-d848bca79223 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.453062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0785df6-4942-4557-aca8-d848bca79223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.460544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.467679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0785df6-4942-4557-aca8-d848bca79223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.470114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0785df6-4942-4557-aca8-d848bca79223 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-a0785df6-4942-4557-aca8-d848bca79223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:23.489738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:23.490716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:23.491626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:23.491626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.491626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:23.491626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 371/741] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:23.492424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41720-e84b-4240-91b5-ddc1ec55c71d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.492703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41720-e84b-4240-91b5-ddc1ec55c71d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.492974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf41720-e84b-4240-91b5-ddc1ec55c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.513614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-3bf41720-e84b-4240-91b5-ddc1ec55c71d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:23.514826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3bf41720-e84b-4240-91b5-ddc1ec55c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:23.542300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41332-608a-4444-82c1-72add5865531 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.577033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.577703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.578008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.578257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.578904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:23.579204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.580582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.593289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 371/742] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:23.594186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.600640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 372/743] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:23.601742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf41720-e84b-4240-91b5-ddc1ec55c71d None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.625356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.706197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.726248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf41720-e84b-4240-91b5-ddc1ec55c71d None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.730448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d58c27-4a61-43ed-a4c5-21788b4f70ba None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.763745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.764456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.764745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.765023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.765831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:23.766140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.767529 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.778372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.779316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.779744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.780186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.781095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 373/744] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:23.782126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.872334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.873808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.878933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.903123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3663f-a274-4d12-8211-6a00efd004e3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.937332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.937968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.938256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.938534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.946195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.947638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:23.958935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:23.959913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 374/745] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:23.960882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.978003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.000273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 372/746] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:24.001279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.077866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e7ce9-c2c0-4fec-ad5b-3e7357804459 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.106823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807645c-6226-4242-9f44-8a06c7b394d0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.117453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.118097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.118387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.118663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.122424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.128445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.130272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:24.141848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:24.142787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 375/747] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:24.143736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.149275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.149896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.150176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.150448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.151096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.152481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.171962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 373/748] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:23 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:24.171962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.232403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.267253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e364-af9e-41f9-b372-ce3afb471508 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.309076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce54de-2453-4c95-b0a4-5ed0a9d8afdd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.312447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.313277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.313733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.314464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.315385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:24.316202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.317659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.338499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 376/749] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:24.339264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.362031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.362440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.363735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.364039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.376846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.379028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:24.395095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:24.396115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:24.397045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:24.397045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:24.397045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:24.397886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 374/750] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:24.398079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.440202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.486277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be297-142a-416a-a5c9-bee800eca5e3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.502926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.511501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1c19a-da37-4ef6-9845-251ee52ea28a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.535155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.536361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.537241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.537682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.538819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:24.539523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.541905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.548328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.549047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.549396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.549754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.561962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.563523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.564976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 377/751] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:24.566870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:24.580047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:24.581218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:24.583204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:24.583204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:24.583204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:24.586375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 375/752] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:24.587383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.705329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0068161-30d8-4553-a722-5a27f456efa1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.709391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71eb0a-7856-4af8-9089-c50b91ee9c0c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.721110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.750685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.751864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.752504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.753056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.754236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.755084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.755370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.755647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.756334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:24.756641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.758327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.772829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.775260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 378/753] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:24.776451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.849110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.851291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.889869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51607a9-e95a-4637-8432-312c3c4cae53 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.928788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.929757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.930273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.930765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.931646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:24.932184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.933754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.950561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 379/754] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:24.956167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.991221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.991411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 376/755] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:03:24.991411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.051709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:25.081845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509f56-4998-4844-9cd6-16c662664b82 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.111136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e33be-3472-43e2-8a17-013a665c84f3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.121091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.121736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.122021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.122296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.129859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.131300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:25.142891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:25.144492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:25.145832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:25.149174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 380/756] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:25.150011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.154642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30668866-681a-4190-9d9b-378b267e7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.155447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30668866-681a-4190-9d9b-378b267e7d9a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.155908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30668866-681a-4190-9d9b-378b267e7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.156343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30668866-681a-4190-9d9b-378b267e7d9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.166754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30668866-681a-4190-9d9b-378b267e7d9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.169069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30668866-681a-4190-9d9b-378b267e7d9a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-30668866-681a-4190-9d9b-378b267e7d9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:25.180719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:25.181792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:25.182893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:25.184955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 377/757] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:25.186373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c007ed-e004-446e-97e8-6f4c45ce43a4 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.186654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c007ed-e004-446e-97e8-6f4c45ce43a4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.186929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c007ed-e004-446e-97e8-6f4c45ce43a4 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.192172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 378/758] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:25.192172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c007ed-e004-446e-97e8-6f4c45ce43a4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.248250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:25.265745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef9447-7d1f-422b-afa5-4f019b66b2c8 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.299430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c007ed-e004-446e-97e8-6f4c45ce43a4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.302151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.302794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.303117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.303400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.307504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:25.315396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.317037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:25.332443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:25.333416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:25.334314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:25.334314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:25.334314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:25.337577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567fcee-d8b5-4ea3-bf80-cf89ac174be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.338327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fcee-d8b5-4ea3-bf80-cf89ac174be7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.338437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 381/759] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:25.338640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fcee-d8b5-4ea3-bf80-cf89ac174be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.339009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567fcee-d8b5-4ea3-bf80-cf89ac174be7 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.339356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.339828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567fcee-d8b5-4ea3-bf80-cf89ac174be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:25.340152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567fcee-d8b5-4ea3-bf80-cf89ac174be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.341652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567fcee-d8b5-4ea3-bf80-cf89ac174be7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.356057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 379/760] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:25.357841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feea86-e6b6-4212-a246-ce393cad97f0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.358355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feea86-e6b6-4212-a246-ce393cad97f0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.358830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feea86-e6b6-4212-a246-ce393cad97f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.379189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-81feea86-e6b6-4212-a246-ce393cad97f0 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:25.380404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-81feea86-e6b6-4212-a246-ce393cad97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:25.448701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 380/761] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:25.449518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feea86-e6b6-4212-a246-ce393cad97f0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.456784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb2b8f-edfa-46e3-b8a2-bac6343255c5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.493516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.494223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.494759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.495106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.495955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:25.496366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.497954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.515741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:25.515741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 382/762] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:25.515741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.583089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:25.592202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feea86-e6b6-4212-a246-ce393cad97f0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.625242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158c3c0-4e67-4bb6-8f1f-353dd126eb9e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.643142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.645430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.645892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.646339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.647155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:25.647650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.650013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.663655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.664397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.664773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.665123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.665985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=316c09203d964b75a1da935349312a48, user.id=52a56e6519a04ac297ef8f2e1094157f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:25.670616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.670616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.671178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 381/763] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:25.672374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.684111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 383/764] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/role_assignments?user.id=52a56e6519a04ac297ef8f2e1094157f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:25.685156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.801855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:25.837538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ddec-85fe-42da-bcbb-924c2ba59b2c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.844476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81aafc-39b5-4d58-b8ee-33aa808f139d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:25.881651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.882252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:25.882377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.882567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.882842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.883673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.884185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.884774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/352b7e4d311d491f8e665d4cf7e554b8/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.887178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=352b7e4d311d491f8e665d4cf7e554b8, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.888869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.889996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:25.891435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:25.905184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:25.906132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:25.907039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:25.908073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 382/765] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:25 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/352b7e4d311d491f8e665d4cf7e554b8/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:25.908984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 384/766] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:25.909588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.917366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:25.946081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.056560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9df8b0-1751-4d92-888f-c2e0d7796898 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.115704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.134709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e093189-9959-47c4-a670-e5f483e6cc02 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.138596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.139222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.139498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.139768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.140513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:26.144831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.147068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.169781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 385/767] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:26.176351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.191996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd57101-1ffd-4244-bea0-2f118be53a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.193042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57101-1ffd-4244-bea0-2f118be53a15 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.193527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57101-1ffd-4244-bea0-2f118be53a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.193982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd57101-1ffd-4244-bea0-2f118be53a15 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.194757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd57101-1ffd-4244-bea0-2f118be53a15 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.196401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd57101-1ffd-4244-bea0-2f118be53a15 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ecd57101-1ffd-4244-bea0-2f118be53a15 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:26.207993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:26.209017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:26.209849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 383/768] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 17 16:03:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:26.211238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1db3-cb32-4bc8-b688-66c86129d4c4 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.211238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1db3-cb32-4bc8-b688-66c86129d4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.211405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1db3-cb32-4bc8-b688-66c86129d4c4 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.212541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 384/769] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:26.220699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1db3-cb32-4bc8-b688-66c86129d4c4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.289962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9b00-6ff3-410a-860e-801159bd84cf None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.325002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.327289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febff57e-920f-42f7-b403-50156f92acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.328226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febff57e-920f-42f7-b403-50156f92acd9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.328656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febff57e-920f-42f7-b403-50156f92acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.329094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febff57e-920f-42f7-b403-50156f92acd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.329965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febff57e-920f-42f7-b403-50156f92acd9 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=36e0031b7d51472d8580f4897c9c420f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:26.330426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febff57e-920f-42f7-b403-50156f92acd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.332361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febff57e-920f-42f7-b403-50156f92acd9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.339445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 386/770] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/role_assignments?user.id=36e0031b7d51472d8580f4897c9c420f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:26.341552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723067-58a7-4e0d-93d3-342a02fe415b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.342048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723067-58a7-4e0d-93d3-342a02fe415b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.342528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723067-58a7-4e0d-93d3-342a02fe415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.348174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1db3-cb32-4bc8-b688-66c86129d4c4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.372979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-48723067-58a7-4e0d-93d3-342a02fe415b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:26.374612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-48723067-58a7-4e0d-93d3-342a02fe415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:26.411868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.412877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.413381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.413859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.414736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:26.415249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.416887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.430349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 385/771] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:26.436891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.463265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.504771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 387/772] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:26.582014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1bd0e-54fc-4ddd-a8ff-83fc0d768cc6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.618356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.618976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.619260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.619537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.620206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:26.620514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.621875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.627201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 386/773] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:26.633090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723067-58a7-4e0d-93d3-342a02fe415b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.797219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723067-58a7-4e0d-93d3-342a02fe415b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.850950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.851577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.851884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.852224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.852940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] RBAC: Adding query filter params (interface=public, service_id=1307e1b0c47d48feb563b48c5b838d89, region_id=RegionOne) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:26.853251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.854881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.871732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.872198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 388/774] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/endpoints?service_id=1307e1b0c47d48feb563b48c5b838d89&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:26.891781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.897756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.989239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.996423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec078c-6dbb-4ad0-bbe2-05b1169a080d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.072673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.073785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.074266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.074759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.075566 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.077189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.084362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 387/775] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.108216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695f498-eaad-4364-a8d8-5aa77726c946 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.173820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.174482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.174761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.175368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] PATH_INFO: `/v3/services/network` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.175677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.177227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:27.196134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:27.197171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:27.197990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:27.202195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 389/776] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/services/network => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:27.203727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.308076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.342746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c365386-a7c6-44a2-85d9-af718cbb6088 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.381362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.381895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.382174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.382445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.383075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] RBAC: Adding query filter params (name=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.383400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.384754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.389715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 388/777] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.395417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.543645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365edc47-d8ee-48f1-8b1a-df0f82b8684f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.554208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.588533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.589150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.589431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.589699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.590338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] RBAC: Adding query filter params (type=network) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.590642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.592054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.597593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 390/778] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.603392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.737358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0634b-544d-45a4-968b-a6ba5b0d69cd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.783204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c19595-410a-4687-9092-348b0d943b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.783785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19595-410a-4687-9092-348b0d943b20 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.784154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19595-410a-4687-9092-348b0d943b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.784967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c19595-410a-4687-9092-348b0d943b20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.786038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c19595-410a-4687-9092-348b0d943b20 None admin] RBAC: Adding query filter params (interface=public, service_id=118505635fe547ec82f14ea5ffa04d0a, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.786345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c19595-410a-4687-9092-348b0d943b20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.787761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c19595-410a-4687-9092-348b0d943b20 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.792744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.797194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 389/779] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/endpoints?service_id=118505635fe547ec82f14ea5ffa04d0a&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.803294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.974893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a63d6-e4f8-431d-9d2c-84a15e2c7c54 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.027056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5958062-7b5d-4a11-96ac-2205e6c5412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.028073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5958062-7b5d-4a11-96ac-2205e6c5412c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.028575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5958062-7b5d-4a11-96ac-2205e6c5412c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.029046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5958062-7b5d-4a11-96ac-2205e6c5412c None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.029862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5958062-7b5d-4a11-96ac-2205e6c5412c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.031463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5958062-7b5d-4a11-96ac-2205e6c5412c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.043955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 391/780] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/services => generated 772 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:28.136653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ea9b-33ce-4a58-906f-8eb22475896b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.137315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ea9b-33ce-4a58-906f-8eb22475896b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.137792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430ea9b-33ce-4a58-906f-8eb22475896b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.139706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 390/781] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:28.147590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1531a-f850-4d0c-9a0e-3289b45fdc89 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.148214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1531a-f850-4d0c-9a0e-3289b45fdc89 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.148690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1531a-f850-4d0c-9a0e-3289b45fdc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.168496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-26f1531a-f850-4d0c-9a0e-3289b45fdc89 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:28.170113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-26f1531a-f850-4d0c-9a0e-3289b45fdc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:28.200117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.251921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 392/782] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:28.351139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e25ce-78bf-4c9d-abbb-3612c41ec704 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.351635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e25ce-78bf-4c9d-abbb-3612c41ec704 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.351635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e25ce-78bf-4c9d-abbb-3612c41ec704 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.353276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 391/783] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:28.358438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9a43-33e0-4765-be37-65ee13b9d4ff None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.358729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9a43-33e0-4765-be37-65ee13b9d4ff None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.359005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac9a43-33e0-4765-be37-65ee13b9d4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.377787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-96ac9a43-33e0-4765-be37-65ee13b9d4ff None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:28.379547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-96ac9a43-33e0-4765-be37-65ee13b9d4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:28.466065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 393/784] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:28.544996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e25ce-78bf-4c9d-abbb-3612c41ec704 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.687535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e25ce-78bf-4c9d-abbb-3612c41ec704 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.734805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.735497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.735719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.736019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.749410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:28.754247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:28.755185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:28.756066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 392/785] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:28.762683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.763166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c5240-022a-4ff5-bf5f-4b9ce76d66d5 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.763476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c5240-022a-4ff5-bf5f-4b9ce76d66d5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.763738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c5240-022a-4ff5-bf5f-4b9ce76d66d5 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.765102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 394/786] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:28.771318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ee0e-2a07-4061-9981-6c4268b46dc8 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.771601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ee0e-2a07-4061-9981-6c4268b46dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.771894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ee0e-2a07-4061-9981-6c4268b46dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.811632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-66a7ee0e-2a07-4061-9981-6c4268b46dc8 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:28.812882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-66a7ee0e-2a07-4061-9981-6c4268b46dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:28.849896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.898368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38977af-0a49-4d60-b098-d8fb5fe49eff None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.908653 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 395/787] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:28.910219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7ee0e-2a07-4061-9981-6c4268b46dc8 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.935520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.936297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.936694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.937064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.937995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:28.938337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.939784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.943860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.948973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 393/788] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:28.954648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.046419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7ee0e-2a07-4061-9981-6c4268b46dc8 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.067826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d22b09-ce70-432f-aabf-437881e12c61 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.095610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.097495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.097932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.098231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.101430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.119536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.120206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.120485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.121659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.123087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:29.135441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.136423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:29.137632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 396/789] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.145507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.146965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.151848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:29.176220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.177507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:29.179921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:29.179921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.179921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:29.179921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 394/790] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:29.189264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.312648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb4099-31cc-466b-957a-f1075c9ee8a0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.334286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.352739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c0269-e2d6-4ca3-8c96-bcea3d23d2be None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.366429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.368076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.369028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.369632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.370609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.371361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.373380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.390064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.390666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.390946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.391220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.392055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 395/791] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.393164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.396026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.396481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.398349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.411511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 397/792] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:29.411511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.446156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.522341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cad77-ff8f-47d8-bf32-f51f90be5835 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.532177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce01672-1bd8-4cb0-bfe0-170f6af25927 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.557870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.558737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.559014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.559317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.567647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.569241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.569362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cc163-af41-4469-90ae-2e9af9217407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.569961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc163-af41-4469-90ae-2e9af9217407 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.570240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc163-af41-4469-90ae-2e9af9217407 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.570507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc163-af41-4469-90ae-2e9af9217407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.580797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cc163-af41-4469-90ae-2e9af9217407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:29.580929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.581862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 398/793] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.587873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9e0cc163-af41-4469-90ae-2e9af9217407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:29.588570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.589397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 396/794] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.590226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6b2d1-31d8-4ddb-8803-31a59b26479b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.590966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6b2d1-31d8-4ddb-8803-31a59b26479b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.590966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6b2d1-31d8-4ddb-8803-31a59b26479b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.594507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 397/795] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:29.595140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6b2d1-31d8-4ddb-8803-31a59b26479b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.598351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.697154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.697561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690abd4-947c-4f94-a169-8dc13b3f1b61 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.705823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6b2d1-31d8-4ddb-8803-31a59b26479b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.734675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.735322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.735605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.735911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.741675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3322a-aeaa-44d7-b1e6-5a5b772e2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.742279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3322a-aeaa-44d7-b1e6-5a5b772e2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.742554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3322a-aeaa-44d7-b1e6-5a5b772e2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.742823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3322a-aeaa-44d7-b1e6-5a5b772e2ba1 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.743954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3322a-aeaa-44d7-b1e6-5a5b772e2ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.744301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3322a-aeaa-44d7-b1e6-5a5b772e2ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.746227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3322a-aeaa-44d7-b1e6-5a5b772e2ba1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.747284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.748772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:29.763966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.764957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:29.765854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:29.765854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.765854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:29.769495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 398/796] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.770117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 399/797] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.770808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda8528-2c17-4dcb-9c65-0d128bb1b6cb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.771060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.771167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda8528-2c17-4dcb-9c65-0d128bb1b6cb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.771353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda8528-2c17-4dcb-9c65-0d128bb1b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.790843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8cda8528-2c17-4dcb-9c65-0d128bb1b6cb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:29.792069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8cda8528-2c17-4dcb-9c65-0d128bb1b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:29.840357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.869075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 399/798] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:29.869922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda8528-2c17-4dcb-9c65-0d128bb1b6cb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.897504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956d710-38b4-4471-b582-b9ab287aebfd None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.937387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.938247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.938628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.938999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.939927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.940334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.942296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.958161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 400/799] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.958161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.992933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.014463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda8528-2c17-4dcb-9c65-0d128bb1b6cb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.052816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.053458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.053740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.054015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.065160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.067262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.073460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0e640-fa47-46de-b988-264f632efd18 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:30.083575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.084587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:30.086090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:30.086090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:30.086090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:30.086090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 400/800] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.086090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.099171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.115755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.116463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.116817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.117169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.117983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.118361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.120088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.137603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 401/801] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.138592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.252585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c9d23-1a8c-4072-aa49-f756feb02fd5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.291696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.292354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.292637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.292912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.293681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.293988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.295493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.308752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 402/802] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.309568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.322079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67090026-171d-44f0-ad99-117c5f2687b6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.354539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.356558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.357268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.357547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.357817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.359698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.369162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.370598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:30.385477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.386592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:30.387665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:30.387665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:30.387665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:30.391268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 401/803] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.392126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.413999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc12a21-5009-4636-ad2f-377c46fdcb11 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.447024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.447658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.447978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.448259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.455650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.457677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:30.468629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.469618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 403/804] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.470556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.494251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca240-09db-4333-9c69-2b7d5d40937c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.528831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c95b3-e2e4-4b51-b8e8-5ba6e86cabe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.529394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c95b3-e2e4-4b51-b8e8-5ba6e86cabe9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.529678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c95b3-e2e4-4b51-b8e8-5ba6e86cabe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.529954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c95b3-e2e4-4b51-b8e8-5ba6e86cabe9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.530539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c95b3-e2e4-4b51-b8e8-5ba6e86cabe9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.531922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c95b3-e2e4-4b51-b8e8-5ba6e86cabe9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0d8c95b3-e2e4-4b51-b8e8-5ba6e86cabe9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.540649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.541631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:30.542498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 402/805] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.543302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4172ac-b418-4dc6-8912-e2687f2b8821 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.543302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4172ac-b418-4dc6-8912-e2687f2b8821 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.543431 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4172ac-b418-4dc6-8912-e2687f2b8821 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.544671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 403/806] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:30.545357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4172ac-b418-4dc6-8912-e2687f2b8821 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.571607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.574825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad4f8-3654-4fae-813d-c7753b3716d5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.596167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.608899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.609537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.609822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.610101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.617558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.619014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:30.630878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.631930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 404/807] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.632831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.653891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4172ac-b418-4dc6-8912-e2687f2b8821 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.688168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.688766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.689043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.689313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.689948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.690248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.691645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.702863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 404/808] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.703629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.734934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9ea51-f5a7-475c-bed3-a0936dca8388 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.767856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398bd55-a18a-456f-9874-2e31c6ca92dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.768469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398bd55-a18a-456f-9874-2e31c6ca92dd None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.769014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398bd55-a18a-456f-9874-2e31c6ca92dd None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.769295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398bd55-a18a-456f-9874-2e31c6ca92dd None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.770028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398bd55-a18a-456f-9874-2e31c6ca92dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.770337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398bd55-a18a-456f-9874-2e31c6ca92dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.771836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398bd55-a18a-456f-9874-2e31c6ca92dd None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.789816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 405/809] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.790932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbb86-1d7e-49a3-a80a-52ea74b1ff49 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.791222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbb86-1d7e-49a3-a80a-52ea74b1ff49 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.791507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efbb86-1d7e-49a3-a80a-52ea74b1ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.804306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825917f-d2e1-490c-bdf1-b0b95cfa1cbe None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.809526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-22efbb86-1d7e-49a3-a80a-52ea74b1ff49 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:30.810740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-22efbb86-1d7e-49a3-a80a-52ea74b1ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:30.814856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.824626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.839332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.840052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.840337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.840643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.841279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.841582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.842932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.849599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 405/810] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.849599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.882971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 406/811] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:30.883843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efbb86-1d7e-49a3-a80a-52ea74b1ff49 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.958800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4e8e-b425-4491-aff4-eccb2997a346 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.992045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efbb86-1d7e-49a3-a80a-52ea74b1ff49 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.999710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.000837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.001151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.001427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.002572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:31.002886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.004991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.025156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 406/812] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:31.025156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.028470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.029114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.029393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.029669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.037888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.039347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:31.051213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:31.052178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:31.053127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:31.056357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 407/813] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:31.057177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.068189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.068692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.143195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711a28e-ebf1-4e7c-bf75-5a24e16e0218 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.166754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99e590-737d-47ed-a095-5ec494bf9594 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.178630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.179233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.179506 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.179773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.200664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.201277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.201562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.201843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.202483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:31.202793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.204202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.214277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 408/814] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:31.214277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.249779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.251208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.283302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.285127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.313140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912335a0-20d8-4475-9d42-4fa4bf6b4c3a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.346525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.347950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.348258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.348546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/52a56e6519a04ac297ef8f2e1094157f/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.350489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=52a56e6519a04ac297ef8f2e1094157f, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.351605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 407/815] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:03:31.351959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.352479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.366865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 409/816] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:31 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/52a56e6519a04ac297ef8f2e1094157f/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:31.367679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.471078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7b64-f452-4850-9fbe-f6b8179d7d9d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.484558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356c9e-7106-4cd9-8d88-6dbb18ffbff8 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.514961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.515584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.515894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.516170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.516909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:31.517292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.518753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.520736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.525717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.531768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.532939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.533552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.534163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] PATH_INFO: `/v3/services/network` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.535347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.537311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.543845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 408/817] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:31.543845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:31.551712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:31.552766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:31.554489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 410/818] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:31.555296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.660104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e399564-3629-4756-a1ec-044ec0192e67 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.662913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8b4a9-1890-4512-b644-1386303b86dd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.696236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.697298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.697680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.697964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.699351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.699995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.700275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.700547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.701211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.702562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.710367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.712187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.731838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 409/819] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:31.731838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:31.732093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:31.732971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:31.733869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:31.733869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:31.733869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:31.733869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 411/820] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:31.733869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.798913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.806278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.891364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b96aa-184f-4128-ac35-6ad498908b03 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.930601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.931185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.931466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.931737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.945703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.947569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:31.965510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:31.966504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:31.967390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:31.967390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:31.967390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:31.968936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 410/821] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:31.969838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.004049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d868620-0ecb-461f-ac19-75219a66cdb7 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.044844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.045758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.046263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.046598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.047303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] RBAC: Adding query filter params (name=network) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:32.047674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.049155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.054746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 412/822] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.055696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.108730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.117653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd2ba-842f-487d-b64f-f170f06c4fee None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.165538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.166153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.166434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.166705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.166935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b544c6-9467-43b8-9bfe-965d8441e103 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.167358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:32.167662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.169336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.180837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.192451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 411/823] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.192451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.222157 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.222770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.223050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.223323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.224071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:32.224292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.225723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.242876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 413/824] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.243794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.332091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9986-e228-4086-a353-067c2941f450 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.352821 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cf016-7a3d-4590-92b8-2da682b3ce09 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.380114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.381236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.381664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.382460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.383538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] RBAC: Adding query filter params (type=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:32.384020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.386418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.393239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.393849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 412/825] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.394051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.394355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.394667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.395616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.402276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.403903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:32.417659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:32.418698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:32.420382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:32.424329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 414/826] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:32.425465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.431899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.467649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.530675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b58e7f-ba06-4dae-af52-0aaaee0ee71c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.561136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d6b4d-01e9-4f1c-8d08-4999e8efe45d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.566842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.567475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.567756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.568132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.575245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.576812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:32.588984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:32.590047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:32.591113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:32.595014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 413/827] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:32.595946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.606958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.608203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.609996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.610675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.611583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.613939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.642060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 415/828] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:32 2022] POST /identity/v3/endpoints => generated 337 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:32.644236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.720729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.770814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903da1d-546f-42d6-89bb-8c569154f5d1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.786329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.826479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.827393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.827834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.828254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.829098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:32.829587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.831909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.836789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896cf9-1fa6-492f-8cd4-33f3c5e4373b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.848614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 414/829] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.854910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.882760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.883651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.883970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.884247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.885076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:32.885357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.886813 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.900780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 416/830] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.907068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.977740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe94e15-0797-4326-834d-9052a6d71c3e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.019135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6d631-4a82-462e-96de-18d4f7f8a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.020310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6d631-4a82-462e-96de-18d4f7f8a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.020791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6d631-4a82-462e-96de-18d4f7f8a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.021110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd0928-760b-4b16-a60a-80a78103b50d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.021467 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6d631-4a82-462e-96de-18d4f7f8a4d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.022486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6d631-4a82-462e-96de-18d4f7f8a4d2 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=316c09203d964b75a1da935349312a48, user.id=352b7e4d311d491f8e665d4cf7e554b8) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:33.023058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6d631-4a82-462e-96de-18d4f7f8a4d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:33.024795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6d631-4a82-462e-96de-18d4f7f8a4d2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:33.028187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:33.033209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 415/831] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/role_assignments?user.id=352b7e4d311d491f8e665d4cf7e554b8&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:33.072663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650c52e-fffa-4afd-87fa-1c35e2179cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.073362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650c52e-fffa-4afd-87fa-1c35e2179cd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.073645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650c52e-fffa-4afd-87fa-1c35e2179cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.073922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650c52e-fffa-4afd-87fa-1c35e2179cd9 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/36e0031b7d51472d8580f4897c9c420f/roles/9c4b8b10d69d46b8aa4ecc21408597f2` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.091763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650c52e-fffa-4afd-87fa-1c35e2179cd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=36e0031b7d51472d8580f4897c9c420f, role_id=9c4b8b10d69d46b8aa4ecc21408597f2)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:33.093449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650c52e-fffa-4afd-87fa-1c35e2179cd9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:33.095990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:33.112109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 417/832] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:32 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/36e0031b7d51472d8580f4897c9c420f/roles/9c4b8b10d69d46b8aa4ecc21408597f2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:33.408290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18beb0-16fe-41cc-aa2d-7134715ec1b9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.408659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18beb0-16fe-41cc-aa2d-7134715ec1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.408953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18beb0-16fe-41cc-aa2d-7134715ec1b9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.410774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 416/833] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:33.415958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddef9a-02ee-4476-b5e9-46c9a3e83074 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.416258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddef9a-02ee-4476-b5e9-46c9a3e83074 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.416537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddef9a-02ee-4476-b5e9-46c9a3e83074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.435509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-33ddef9a-02ee-4476-b5e9-46c9a3e83074 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:33.436745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-33ddef9a-02ee-4476-b5e9-46c9a3e83074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:33.511445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 418/834] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:33.782489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18beb0-16fe-41cc-aa2d-7134715ec1b9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.863722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029331c6-e2f0-4e7b-9468-d62cf901d052 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.864258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029331c6-e2f0-4e7b-9468-d62cf901d052 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.864350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029331c6-e2f0-4e7b-9468-d62cf901d052 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.865878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 419/835] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:33.870749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31df4c-cba8-4039-867d-9d927cb2b3f3 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.871028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31df4c-cba8-4039-867d-9d927cb2b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.871309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31df4c-cba8-4039-867d-9d927cb2b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.889283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-bd31df4c-cba8-4039-867d-9d927cb2b3f3 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:33.890466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bd31df4c-cba8-4039-867d-9d927cb2b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:33.908602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18beb0-16fe-41cc-aa2d-7134715ec1b9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.943933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.944562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.944836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.945103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.955770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:33.961348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:33.962287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:33.963129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 417/836] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:33.969517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.991839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 420/837] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:34.036260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.077924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad086-e67f-48ad-bcbb-143c5d4a4d14 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.114229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.114840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.115171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.115448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.116153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.116455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.117819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.126754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 418/838] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:34.132955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31df4c-cba8-4039-867d-9d927cb2b3f3 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.206661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.239687 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31df4c-cba8-4039-867d-9d927cb2b3f3 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.277767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.278434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.278717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.278989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.281830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.292491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.294521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:34.313828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.314799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:34.315941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:34.315941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:34.315941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:34.315941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 421/839] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:34.323056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.396139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc7eb-2a1c-4a31-997c-a9d189b7d4bd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.426590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40f372-1259-4039-a3ab-9eb51f7085fb None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.428217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.433518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.436029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.436876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.437314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.437744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.438504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.440186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.451537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.452551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:34.453363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:34.461359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 419/840] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:34.462317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.462667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.462930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.463211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.463485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.464231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.464527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.466065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.484019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 422/841] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:34.485953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.575124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef5847-8bca-4d4c-a0a8-c35950b3c41b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.593618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb14885-c8ea-4239-94ea-7f6e5cc7cee2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.614006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.614992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.615529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.616033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.616911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.617410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.619172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.630004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 420/842] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.630487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.631449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.631640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.631988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.632395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.640424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.642365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:34.655885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.656996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:34.657951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 423/843] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:34.664023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.691120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.698272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.750416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f410c9-049b-4e06-b67b-b6843a971352 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.778722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d671d8a-997f-4b1c-a47c-b76683f50d41 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.791912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.793156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.793631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.794126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.795066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.795552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.797086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.812421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 421/844] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.817558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80dd5d-394b-4282-bee2-698c6b5dec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.818291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80dd5d-394b-4282-bee2-698c6b5dec5b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.818641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80dd5d-394b-4282-bee2-698c6b5dec5b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.818988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80dd5d-394b-4282-bee2-698c6b5dec5b None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.819847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80dd5d-394b-4282-bee2-698c6b5dec5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.820231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80dd5d-394b-4282-bee2-698c6b5dec5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.821795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80dd5d-394b-4282-bee2-698c6b5dec5b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.854206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 424/845] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.860091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.978339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0652ef4-9824-4e75-a78d-250ccf91a6bf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.994278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.019142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.020117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.020402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.020676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.094993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f890-8f6a-4bd4-9a84-e3aa6e1fceb3 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.095767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f890-8f6a-4bd4-9a84-e3aa6e1fceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.095767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978f890-8f6a-4bd4-9a84-e3aa6e1fceb3 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.098162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 425/846] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:35.101474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.103097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.104413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba000-c6ef-403d-bd1b-006632f0e79e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.104974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba000-c6ef-403d-bd1b-006632f0e79e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.105452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba000-c6ef-403d-bd1b-006632f0e79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.124704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-577ba000-c6ef-403d-bd1b-006632f0e79e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:35.126315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-577ba000-c6ef-403d-bd1b-006632f0e79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:35.198332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 426/847] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:35.199986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8c9e-acc3-4b78-92f6-ad9ba2a67064 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.200141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8c9e-acc3-4b78-92f6-ad9ba2a67064 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.200386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a8c9e-acc3-4b78-92f6-ad9ba2a67064 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.201747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 427/848] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:35.207019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af3f0e-c5fc-4a1f-ab16-cdf2c84cd7c1 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.207306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af3f0e-c5fc-4a1f-ab16-cdf2c84cd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.207582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af3f0e-c5fc-4a1f-ab16-cdf2c84cd7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.239755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 422/849] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:03:35.241296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-96af3f0e-c5fc-4a1f-ab16-cdf2c84cd7c1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:35.243442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-96af3f0e-c5fc-4a1f-ab16-cdf2c84cd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:35.245593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.255618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.265534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.342301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 428/850] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:35.373430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc3b8e-9494-4363-8e8b-491d9ea6344f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.414294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.415243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.415705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.416184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.427499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.429243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:35.446399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.447631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:35.448554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:35.448554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.448554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:35.450454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 423/851] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:35.457416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af3f0e-c5fc-4a1f-ab16-cdf2c84cd7c1 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.495228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.571815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.575519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af3f0e-c5fc-4a1f-ab16-cdf2c84cd7c1 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.615912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.616539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.616825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.617106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.617766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:35.618075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.618943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50eed-7e3a-4241-ab15-ca849059a34e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.619450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.635905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 429/852] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:35.640528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.644736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.664842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.666256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.666877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.667412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.679021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:35.685096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.686111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:35.686964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:35.691046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 424/853] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:35.691925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.748902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dffa7-0d8a-4263-85e1-d09c34016489 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.791141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.792590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.793021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.793628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.797086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3664c3-dfc8-4845-8208-91b46c1ddd10 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.803493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.804988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:35.816352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.817235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:35.818128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:35.822471 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 430/854] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:35.823132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.830239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.844701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.845485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.845773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.846050 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.847228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.848637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.857805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.858748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:35.859631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 425/855] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:35.860463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.897977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.940363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3530f4-ad6d-4a2d-a9ea-ab97eff52291 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.970711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82435-10f3-467a-9888-d44ac3d4051e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.978511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.979936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.980403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.980861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.981875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:35.982190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.983904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.993971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 431/856] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:35.994768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.014241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.015557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.016104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.016577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.017464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.018427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.020342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.039846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 426/857] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.039846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.093252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.103584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14d612-ab9b-455b-9365-00afe8fc34fa None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.130581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.139694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.140352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.140614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.140889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.141521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.141827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.143237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.152442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 432/858] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.152582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f52870-b524-4899-9a42-35e3d120cf6b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.152678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.187985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.188621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.188903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.189226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.200277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.201712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:36.224383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:36.225368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:36.226248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:36.226248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:36.226248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:36.226248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 427/859] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:36.226468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.264343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3106f-cee1-4469-96e5-e177f4a68155 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.299550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.300230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.300575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.300884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.301616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=316c09203d964b75a1da935349312a48, user.id=52a56e6519a04ac297ef8f2e1094157f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.301913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.303356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.312130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 433/860] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/role_assignments?user.id=52a56e6519a04ac297ef8f2e1094157f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.313823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.342228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6fb9-abe1-43e7-81d7-0080b850dda7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.344647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.388424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.389121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.389406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.389682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.390338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.390666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.392133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.398390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 428/861] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.401666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.465261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740588d5-e2af-4faf-8100-714370f95ef4 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.505933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.506569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.506853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.507131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.507817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.508137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.509548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.524916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 434/862] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.530330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.646104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcd58e-1ff1-419e-90ee-da97e33ddad4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.686712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cc5da-623c-475d-8973-19571d3137f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.687354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc5da-623c-475d-8973-19571d3137f4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.687630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc5da-623c-475d-8973-19571d3137f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.687928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc5da-623c-475d-8973-19571d3137f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.696211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc5da-623c-475d-8973-19571d3137f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.697645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc5da-623c-475d-8973-19571d3137f4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1e5cc5da-623c-475d-8973-19571d3137f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:36.709267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:36.710226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:36.711160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 429/863] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:36.717941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.834688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2bb92-c829-42ad-acfe-23e5de31d6ec None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.838312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33361948-4497-40a1-abd2-0643a2fdee8b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.838752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33361948-4497-40a1-abd2-0643a2fdee8b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.838852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33361948-4497-40a1-abd2-0643a2fdee8b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.840477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 430/864] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:36.845615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a73991-99e6-4edd-a87c-1301ecdc20d2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.845892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a73991-99e6-4edd-a87c-1301ecdc20d2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.846166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a73991-99e6-4edd-a87c-1301ecdc20d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.861659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.866181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a4a73991-99e6-4edd-a87c-1301ecdc20d2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:36.867367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a4a73991-99e6-4edd-a87c-1301ecdc20d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:36.876540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.877680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.878051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.878468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.879654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.880193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.882405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.890868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.910258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 435/865] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.916303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.951906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 431/866] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:37.025535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c57e2-b684-41da-a7d4-8674d96ffcb0 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.064841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.065564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.065853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.066128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.110751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:37.138792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:37.140299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:37.240014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a73991-99e6-4edd-a87c-1301ecdc20d2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:37.253277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 436/867] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:03:37.259271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:37.349633 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:37.367101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a73991-99e6-4edd-a87c-1301ecdc20d2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.384743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6122c-dd6b-41e2-b42b-90b0b28d0321 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.407144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.407793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.408095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.408366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.409050 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:37.410818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:37.427665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.428343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.428621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.428942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.432742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 432/868] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:37 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:37.454792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:37.457011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:37.474294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:37.475327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:37.476298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:37.476298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:37.476298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:37.476298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 437/869] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:37.481441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:37.507504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:37.614671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1318a-d426-40f4-ac69-8fde1f15fdc0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.653061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.653672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.653952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.654228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.654869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:37.655172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:37.656575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:37.669701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 433/870] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:37.675892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:37.778750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcd1fb-4c94-4d26-8336-25348e8071d5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.803538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:37.814691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.816445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.816726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.817780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.824460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:37.825921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:37.838646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:37.839502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:37.840426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 438/871] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:37.845933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:37.923452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:37.958954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d37f42-ac04-41ff-8d9b-5207aa1cb63b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.997892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856041cc-45ad-4842-96e0-82957d965c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.998880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856041cc-45ad-4842-96e0-82957d965c83 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.999379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856041cc-45ad-4842-96e0-82957d965c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.999893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856041cc-45ad-4842-96e0-82957d965c83 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.000875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856041cc-45ad-4842-96e0-82957d965c83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:38.001390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856041cc-45ad-4842-96e0-82957d965c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.003100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856041cc-45ad-4842-96e0-82957d965c83 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.016370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 434/872] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:38.025959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.136439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cbdb3-a054-449a-86f2-e72f1149f180 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:38.172511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4bd4-3408-4598-ae4d-31c3b8ea719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:38.173545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4bd4-3408-4598-ae4d-31c3b8ea719a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.174032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4bd4-3408-4598-ae4d-31c3b8ea719a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.174524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4bd4-3408-4598-ae4d-31c3b8ea719a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.176129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4bd4-3408-4598-ae4d-31c3b8ea719a None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=36e0031b7d51472d8580f4897c9c420f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:38.176646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4bd4-3408-4598-ae4d-31c3b8ea719a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.178387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4bd4-3408-4598-ae4d-31c3b8ea719a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.185097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 439/873] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/role_assignments?user.id=36e0031b7d51472d8580f4897c9c420f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:38.414278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10669e-6845-4e64-a20d-74598196143e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.414598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10669e-6845-4e64-a20d-74598196143e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.414892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10669e-6845-4e64-a20d-74598196143e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.416518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 435/874] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:38.422212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42363-10e3-4744-aa9d-a2e58425bd5f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.422560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42363-10e3-4744-aa9d-a2e58425bd5f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.422842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea42363-10e3-4744-aa9d-a2e58425bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.442554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cea42363-10e3-4744-aa9d-a2e58425bd5f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:38.443667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cea42363-10e3-4744-aa9d-a2e58425bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:38.485337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597591-9551-49c4-a4f5-26b2867dcc69 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.485676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597591-9551-49c4-a4f5-26b2867dcc69 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.485901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d597591-9551-49c4-a4f5-26b2867dcc69 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.487824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 436/875] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:38.492094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:38.493260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8974645-7e8e-4d22-972b-244c7720e553 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.493549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8974645-7e8e-4d22-972b-244c7720e553 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.493827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8974645-7e8e-4d22-972b-244c7720e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.514545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c8974645-7e8e-4d22-972b-244c7720e553 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:38.515741 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c8974645-7e8e-4d22-972b-244c7720e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:38.519887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 440/876] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:38.589493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 437/877] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:38.781651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42363-10e3-4744-aa9d-a2e58425bd5f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.875213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8974645-7e8e-4d22-972b-244c7720e553 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.891370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea42363-10e3-4744-aa9d-a2e58425bd5f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:38.937816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:38.939085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.939983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.940610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.941440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.943675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.954044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:38.957720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:38.958723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:38.959568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:38.961214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 441/878] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:38.966836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.014829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8974645-7e8e-4d22-972b-244c7720e553 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.015764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:39.064858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.066871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.067360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.068095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.068786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:39.070153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:39.088580 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cdd8d-98a2-4feb-a7a2-c80518589915 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.092839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 438/879] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:38 2022] POST /identity/v3/services => generated 269 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:39.144166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88af974-6c43-47d4-9073-ddacaba0955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.145575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88af974-6c43-47d4-9073-ddacaba0955d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.146045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88af974-6c43-47d4-9073-ddacaba0955d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.146651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88af974-6c43-47d4-9073-ddacaba0955d None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.147542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88af974-6c43-47d4-9073-ddacaba0955d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:39.148091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88af974-6c43-47d4-9073-ddacaba0955d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:39.149877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88af974-6c43-47d4-9073-ddacaba0955d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:39.156196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 442/880] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:39.161910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.286657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6dcbb-88c3-4b4d-8f32-157439e91991 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.311007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:39.326435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749d308-7319-4019-906f-b305eebb7a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.327098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749d308-7319-4019-906f-b305eebb7a1d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.327421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749d308-7319-4019-906f-b305eebb7a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.327697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749d308-7319-4019-906f-b305eebb7a1d None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.328362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749d308-7319-4019-906f-b305eebb7a1d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:39.328827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749d308-7319-4019-906f-b305eebb7a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:39.330263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749d308-7319-4019-906f-b305eebb7a1d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:39.338675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 439/881] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:39.516510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6bec-23d7-4a91-bd26-e1c6832cdf1b None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.516875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6bec-23d7-4a91-bd26-e1c6832cdf1b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.517072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6bec-23d7-4a91-bd26-e1c6832cdf1b None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.519396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 443/882] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:39.524612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3587b-ad48-40ac-9895-b162ad62490c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.524898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3587b-ad48-40ac-9895-b162ad62490c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.525170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3587b-ad48-40ac-9895-b162ad62490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.544072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9fb3587b-ad48-40ac-9895-b162ad62490c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:39.545317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9fb3587b-ad48-40ac-9895-b162ad62490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:39.617040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 440/883] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:39.890320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6bec-23d7-4a91-bd26-e1c6832cdf1b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.998122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6bec-23d7-4a91-bd26-e1c6832cdf1b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.999905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.036034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.036680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.036961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.037234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.037815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.039258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:40.048248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:40.049220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:40.050281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 444/884] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:40.055483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3587b-ad48-40ac-9895-b162ad62490c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.160256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3587b-ad48-40ac-9895-b162ad62490c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.177516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.196008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dcab8-3028-4ee8-84a4-c8433aabb450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.196621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dcab8-3028-4ee8-84a4-c8433aabb450 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.196901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dcab8-3028-4ee8-84a4-c8433aabb450 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.197177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dcab8-3028-4ee8-84a4-c8433aabb450 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.197816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dcab8-3028-4ee8-84a4-c8433aabb450 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.198124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dcab8-3028-4ee8-84a4-c8433aabb450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.199489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dcab8-3028-4ee8-84a4-c8433aabb450 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.204907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 441/885] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.211452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.247427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f34a-c4f1-4c3e-bff7-74185cd6c022 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.247774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f34a-c4f1-4c3e-bff7-74185cd6c022 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.248022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f34a-c4f1-4c3e-bff7-74185cd6c022 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.249476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 442/886] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:40.255318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb57f5-a000-44aa-be3e-ee3405a8b68e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.255601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb57f5-a000-44aa-be3e-ee3405a8b68e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.255903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb57f5-a000-44aa-be3e-ee3405a8b68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.277910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2aeb57f5-a000-44aa-be3e-ee3405a8b68e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:40.279127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2aeb57f5-a000-44aa-be3e-ee3405a8b68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:40.323372 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bdd7d-7616-4f40-b70f-beb1563c8dd6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.362436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.363613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.364127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.364617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.365471 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.365997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.367589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.371952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 443/887] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:40.376379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 445/888] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.382550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb57f5-a000-44aa-be3e-ee3405a8b68e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.494231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb57f5-a000-44aa-be3e-ee3405a8b68e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.507363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.533199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.534769 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.535361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.535897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.536818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] RBAC: Adding query filter params (interface=public, service_id=157d10ab901c44b8aec4cdc4faa4caf0, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.537334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.538912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.544815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 444/889] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/endpoints?service_id=157d10ab901c44b8aec4cdc4faa4caf0&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:40.553126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.588268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.654085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.661773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b1136-a765-45fe-8a45-9b942cdb474a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.696790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.697810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.698320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.698836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.699656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.701251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.708379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 446/890] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:03:40.768151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865f7e-6c48-4430-9226-2d5919adad23 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.809314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.809970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.810255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.810533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.823464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:40.828488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:40.829458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:40.830298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 445/891] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:40.836134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.943127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.950106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f092cf8-e1bd-4683-a026-4c572aa75698 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.986143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.986758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.987096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.987374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.988081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.988385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.989752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.998484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 447/892] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:41.004047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.042437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.113334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cec2e-f767-403e-a9fd-2941230df0a6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.150083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf9344-eb24-4e43-8906-6bc38d25be93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.151138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9344-eb24-4e43-8906-6bc38d25be93 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.151645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9344-eb24-4e43-8906-6bc38d25be93 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.152150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9344-eb24-4e43-8906-6bc38d25be93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.163628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9344-eb24-4e43-8906-6bc38d25be93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.165396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9344-eb24-4e43-8906-6bc38d25be93 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-44bf9344-eb24-4e43-8906-6bc38d25be93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:41.181033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:41.182009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:41.182898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:41.182898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:41.182898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:41.185048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 446/893] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:41.192913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.202403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e40c-7383-4c46-aca1-f5c3ed722e55 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.202727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e40c-7383-4c46-aca1-f5c3ed722e55 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.202952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e40c-7383-4c46-aca1-f5c3ed722e55 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.204612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 447/894] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:41.211389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d144-a5ea-431f-8864-de9b0c0c98af None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.211676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d144-a5ea-431f-8864-de9b0c0c98af None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.211977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d144-a5ea-431f-8864-de9b0c0c98af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.235923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-99c9d144-a5ea-431f-8864-de9b0c0c98af None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:41.237146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-99c9d144-a5ea-431f-8864-de9b0c0c98af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:41.329526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae014d-10d6-4594-b5af-94a5c6210f8d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.339890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 448/895] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:41.353111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7bfaa-1530-428a-8c6e-754b5c8464bf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.353401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7bfaa-1530-428a-8c6e-754b5c8464bf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.353949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7bfaa-1530-428a-8c6e-754b5c8464bf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.355542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 449/896] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:41.360509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48dac-5a78-44c8-870e-3a0283647e45 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.360794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48dac-5a78-44c8-870e-3a0283647e45 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.361072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f48dac-5a78-44c8-870e-3a0283647e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.371873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.372851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.373392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.374289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.375153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:41.375945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.378109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.380419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-61f48dac-5a78-44c8-870e-3a0283647e45 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:41.381693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-61f48dac-5a78-44c8-870e-3a0283647e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:41.395432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 448/897] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:41.396385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.402379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.429008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.468279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 450/898] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:41.530395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0354b2-57c7-4fe1-bc8c-57d4a42cde40 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.565023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.566033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.566485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.566908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.574106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.575859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:41.588280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:41.589437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:41.590626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:41.592779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 449/899] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:41.599224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48dac-5a78-44c8-870e-3a0283647e45 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.652462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.710482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f48dac-5a78-44c8-870e-3a0283647e45 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.741294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.755543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.756500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.757014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.757501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.758569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:41.759142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.760800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.769810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a08f4-2d2b-46f9-b675-469129a632de None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.781185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 451/900] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:41.782200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.788213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.813854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.814831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.815444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.816010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.816916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.818496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:41.828086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:41.829040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:41.829934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:41.832986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 450/901] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:41.833956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.907245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ad12-8be3-4579-b852-2fa4ba296164 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.944166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.945068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.945753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.946038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.946952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.948396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979974e0-7f11-4e8d-a423-1a05166db26c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.948502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.964968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 452/902] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:41 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:41.965934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.004469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.005513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.005862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.006213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.011105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.063079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.117634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.119115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.119224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14784661-94a4-49a5-86d8-5e5b458642b0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.159344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.160038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.160311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.160579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.161879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.161879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.162907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.171885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 453/903] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:42.175899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.245135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 451/904] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:03:42.251305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.291825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.320927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcd830-2864-4f79-ac65-e9bd605b18c9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.361173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.367842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a593c-bf7d-4b03-8f97-982f573b2cc5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.373912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.374813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.375360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.375868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.377210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.378340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.381027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.388784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 454/905] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:42.394679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.412567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.413673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.414152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.414916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.430276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.431826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:42.453034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:42.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:42.454945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:42.454945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.454945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:42.462081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 452/906] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:42.463122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.515697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ca4e9-a2c0-45fc-9bba-6286a4b250c0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.552868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.553552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.553836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.554113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.554878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] RBAC: Adding query filter params (interface=public, service_id=9a162431fce64b4999624e964c596929, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.555197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.556688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.562234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 455/907] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/endpoints?service_id=9a162431fce64b4999624e964c596929&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:42.568432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.585585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.602997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430cc67-c74a-4bdb-830f-337ea4453ce6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.636737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.651934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.652826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.653507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.653993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.655666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.656194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.657866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.680274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 453/908] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:42.682653 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.693528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dcab4-2b2e-4f53-a52c-645e544a2c25 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.730279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c1e48-6e08-40e5-a8c4-e9e81df1ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.730975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1e48-6e08-40e5-a8c4-e9e81df1ed54 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.731256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1e48-6e08-40e5-a8c4-e9e81df1ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.731518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1e48-6e08-40e5-a8c4-e9e81df1ed54 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.732161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c1e48-6e08-40e5-a8c4-e9e81df1ed54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.733510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c1e48-6e08-40e5-a8c4-e9e81df1ed54 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.740482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 456/909] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:03:42.741614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280912-b6f4-4266-ae4a-cad0a030f4b8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.741897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280912-b6f4-4266-ae4a-cad0a030f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.742169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280912-b6f4-4266-ae4a-cad0a030f4b8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.747370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 457/910] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:42.748931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f2c9-dadb-4ce0-a929-ff18454e4e92 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.749218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f2c9-dadb-4ce0-a929-ff18454e4e92 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.749490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114f2c9-dadb-4ce0-a929-ff18454e4e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.770007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7114f2c9-dadb-4ce0-a929-ff18454e4e92 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:42.771226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7114f2c9-dadb-4ce0-a929-ff18454e4e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:42.830366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0514a60-bd43-410c-bb5b-42a58cb31872 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.871833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 458/911] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:42.885364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.886009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.886291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.886565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.894018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.895473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:42.906900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:42.907781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:42.909254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 454/912] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:42.914794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114f2c9-dadb-4ce0-a929-ff18454e4e92 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.968204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.025163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114f2c9-dadb-4ce0-a929-ff18454e4e92 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.061757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.062368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.062709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.062985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.063680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.064027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.065836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.082819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 459/913] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.084984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.096590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.155324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.201367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747224a2-f213-4e76-9181-41a096d9ac9b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.240894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.241777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.241777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.242048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.242783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] RBAC: Adding query filter params (role.id=b52cdf8fb6f541d8947b6077b5e598b4, scope.project.id=316c09203d964b75a1da935349312a48, user.id=36e0031b7d51472d8580f4897c9c420f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.243092 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.244670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.250787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 455/914] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/role_assignments?user.id=36e0031b7d51472d8580f4897c9c420f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b52cdf8fb6f541d8947b6077b5e598b4 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.283552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173817e-b333-4ac5-a90b-c60df2dd2655 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.296604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.329604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.330343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.330678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.330987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.331671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.333197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:43.343146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:43.344226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:43.345084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 460/915] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:43.352982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.431273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.476628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d029-b22c-4daa-ad04-ea40c6b9469f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.513570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.514568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.515066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.515534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.516399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.516945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.518698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.524429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 456/916] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.534211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.641785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb80607-d026-4c17-b20f-ff9afd423981 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.677744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049252bc-93c8-45d3-8543-dd947dfedc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.678363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049252bc-93c8-45d3-8543-dd947dfedc73 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.678644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049252bc-93c8-45d3-8543-dd947dfedc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.678925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049252bc-93c8-45d3-8543-dd947dfedc73 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.679560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049252bc-93c8-45d3-8543-dd947dfedc73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.679894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049252bc-93c8-45d3-8543-dd947dfedc73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.681257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049252bc-93c8-45d3-8543-dd947dfedc73 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.686723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 461/917] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.692836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.797919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0d588-674f-4e24-8565-00df3c17a1be None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.833010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b1caf-b46a-41b2-a0f2-dad20199ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.833938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b1caf-b46a-41b2-a0f2-dad20199ae54 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.834306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b1caf-b46a-41b2-a0f2-dad20199ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.834585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b1caf-b46a-41b2-a0f2-dad20199ae54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.835488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b1caf-b46a-41b2-a0f2-dad20199ae54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.838088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b1caf-b46a-41b2-a0f2-dad20199ae54 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.848237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.872026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 457/918] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:43.983974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633289de-e980-4606-866f-70d772fa0c06 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.984292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633289de-e980-4606-866f-70d772fa0c06 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.984547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633289de-e980-4606-866f-70d772fa0c06 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.986301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 462/919] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:43.993019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07053-a786-44af-a92d-ae1045d81e36 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.993307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07053-a786-44af-a92d-ae1045d81e36 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.993729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab07053-a786-44af-a92d-ae1045d81e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.017107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-bab07053-a786-44af-a92d-ae1045d81e36 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:44.018942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bab07053-a786-44af-a92d-ae1045d81e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:44.096702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 458/920] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:44.369285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633289de-e980-4606-866f-70d772fa0c06 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.415023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:44.482512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633289de-e980-4606-866f-70d772fa0c06 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.518695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.519341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.519623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.519930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.520522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.521880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:44.530945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:44.532025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:44.533323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 463/921] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:44.538574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab07053-a786-44af-a92d-ae1045d81e36 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.642814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab07053-a786-44af-a92d-ae1045d81e36 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.660832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:44.679592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46238ed6-1ec2-4042-bbd1-5c0ec8a87729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.680274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46238ed6-1ec2-4042-bbd1-5c0ec8a87729 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.680563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46238ed6-1ec2-4042-bbd1-5c0ec8a87729 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.680873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46238ed6-1ec2-4042-bbd1-5c0ec8a87729 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.681517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46238ed6-1ec2-4042-bbd1-5c0ec8a87729 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:44.681825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46238ed6-1ec2-4042-bbd1-5c0ec8a87729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.683229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46238ed6-1ec2-4042-bbd1-5c0ec8a87729 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.688757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 459/922] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:44.695177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.804738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21f1d2-c217-401e-91ca-288c0d1f5f85 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.806375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:44.837648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7d60-c74d-435e-babe-9e7a24668310 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.838056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7d60-c74d-435e-babe-9e7a24668310 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.838442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf7d60-c74d-435e-babe-9e7a24668310 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.840330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 460/923] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:44.845374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e62ba-9cb4-42ac-b69a-eb9f175af1b7 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.845761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e62ba-9cb4-42ac-b69a-eb9f175af1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.846190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e62ba-9cb4-42ac-b69a-eb9f175af1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.847546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.848367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.848807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.849236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.850029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:44.850603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.852359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.859313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 464/924] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:44.865335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.871063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4c2e62ba-9cb4-42ac-b69a-eb9f175af1b7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:44.872430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4c2e62ba-9cb4-42ac-b69a-eb9f175af1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:44.953878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 461/925] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:44.995352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d4f0-5d66-4833-8841-eb11d6141ad9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.033465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.034760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.035282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.035569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.036331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] RBAC: Adding query filter params (interface=public, service_id=96a74095a38446eaa586588712ebc24d, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:45.036639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.038031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.044585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 465/926] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/endpoints?service_id=96a74095a38446eaa586588712ebc24d&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:45.050439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e62ba-9cb4-42ac-b69a-eb9f175af1b7 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.160291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e62ba-9cb4-42ac-b69a-eb9f175af1b7 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.175394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.198217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d19c6-31d3-4b5f-8913-4cbe4d786f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.198830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d19c6-31d3-4b5f-8913-4cbe4d786f33 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.199109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d19c6-31d3-4b5f-8913-4cbe4d786f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.199382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d19c6-31d3-4b5f-8913-4cbe4d786f33 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.200025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d19c6-31d3-4b5f-8913-4cbe4d786f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.201391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d19c6-31d3-4b5f-8913-4cbe4d786f33 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.208319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 462/927] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:03:45.238705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.267609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6599ee-a339-4e20-8905-ab3c2feb91d3 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.267960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6599ee-a339-4e20-8905-ab3c2feb91d3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.268907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6599ee-a339-4e20-8905-ab3c2feb91d3 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.270609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 463/928] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:45.275598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.276145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8e9c-10e9-42f8-96a6-c92a6cf5d7c7 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.276436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8e9c-10e9-42f8-96a6-c92a6cf5d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.276714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a8e9c-10e9-42f8-96a6-c92a6cf5d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.298808 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-955a8e9c-10e9-42f8-96a6-c92a6cf5d7c7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:45.300119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-955a8e9c-10e9-42f8-96a6-c92a6cf5d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:45.374112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd51bb5-1fc4-4e06-a8a6-d50b506fe24b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.389615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 464/929] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:45.412676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.413310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.413587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.413853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.414435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.415787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:45.425950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:45.426949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:45.427893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:45.432027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 466/930] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:45.433442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8e9c-10e9-42f8-96a6-c92a6cf5d7c7 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.541397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a8e9c-10e9-42f8-96a6-c92a6cf5d7c7 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.551324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.580025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.581808 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.582344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.582796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.583688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:45.584275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.585894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.595980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 465/931] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:45.598221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.665292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.709997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.722609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c57ff-6c42-4384-8379-af13cd0cd6eb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.761756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.762382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.762666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.762939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.763678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:45.764012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.765491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.771455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 467/932] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:45.773501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e216b0-5828-4484-a719-0762433d39d6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.777316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.810317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.810875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.811149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.811416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.822228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:45.827107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:45.828106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:45.828957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 466/933] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:45.835493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.875777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.897302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4eaf2-fdba-4b49-aa0e-0894bb252dcc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.933416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b913e0b-090c-45ca-99ea-9f512f79b428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.934391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b913e0b-090c-45ca-99ea-9f512f79b428 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.934875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b913e0b-090c-45ca-99ea-9f512f79b428 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.935380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b913e0b-090c-45ca-99ea-9f512f79b428 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.936365 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b913e0b-090c-45ca-99ea-9f512f79b428 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.937923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b913e0b-090c-45ca-99ea-9f512f79b428 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.954816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50d8bb-0e0f-4635-8d90-2f871b7c1376 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.960961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 468/934] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:46.003271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663c2d6-523f-4190-95ed-2a84885593ba None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.003714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663c2d6-523f-4190-95ed-2a84885593ba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.004147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663c2d6-523f-4190-95ed-2a84885593ba None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.006036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 469/935] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:46.011507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306b9f-9cf5-47fa-a568-1f5732c88b01 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.011792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306b9f-9cf5-47fa-a568-1f5732c88b01 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.012092 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306b9f-9cf5-47fa-a568-1f5732c88b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.013430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.014078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.014363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.014673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.015343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:46.015692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.017283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.028692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 467/936] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:46.033353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-52306b9f-9cf5-47fa-a568-1f5732c88b01 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:46.035685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-52306b9f-9cf5-47fa-a568-1f5732c88b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:46.035861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.046389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.124439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 470/937] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:46.149281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.168120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e62395-8274-4306-8959-e4c29785be7b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.204300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.204946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.205228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.206076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.218260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.219736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:46.235750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:46.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:46.239258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:46.239258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:46.239258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.239258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 468/938] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:46.243547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306b9f-9cf5-47fa-a568-1f5732c88b01 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.350350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306b9f-9cf5-47fa-a568-1f5732c88b01 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.388897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.389498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.389871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.389980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.391020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.392393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:46.392701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.394104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.406171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 471/939] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:46.412315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.416871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.525753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbae72-7aa7-41ac-bdcd-411f9d963912 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.533090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cb358-4d5a-4861-90bd-a62f9aa20c7d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.570040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.570990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.571273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.571545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.572238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.573876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.574256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.574893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.575190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.575497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.576473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING keystone.server.flask.common [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 16:03:46.584326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.585827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.590581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:46.601302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:46.602303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:46.603266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:46.607752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 472/940] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:46.608756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.608998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.sql.core [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:03:46.608998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 16:03:46.608998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [parameters: {'id': '2a350fc8f9414333a67f47e78149bd8f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 16:03:46.608998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81704) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a350fc8f9414333a67f47e78149bd8f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a350fc8f9414333a67f47e78149bd8f. Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:03:46.619042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result.read() Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 16:03:46.620063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application yield resource Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise self.value Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application session.commit() Aug 17 16:03:46.621012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:03:46.623198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:03:46.624154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result.read() Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:03:46.626920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [parameters: {'id': '2a350fc8f9414333a67f47e78149bd8f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.629533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:46.631559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a350fc8f9414333a67f47e78149bd8f. Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 469/941] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Aug 17 16:03:46 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:46.634505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.702504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.752415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e9d1-5413-4122-8aba-363e87ca21c1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.759271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8dc1c-934b-431b-8e1d-da8bb118bbfc None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.793468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.794504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.794926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.795338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.796415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:46.796645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.797044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.797473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.797862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.798233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.800051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.806394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.808221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:46.820871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:46.821918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:46.822836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:46.823363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 473/942] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:46.825101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 470/943] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:46.826947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.832998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.943296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b94d7-5cd1-4748-a648-586a549b066b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.949053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.964775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebc923-c0fd-4a27-8053-234a557b4faa None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.979832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.991470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.992141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.992418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.992691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.006835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.008328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.010972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce483a7-1668-48fb-a4ae-ec6cb544421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.011751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce483a7-1668-48fb-a4ae-ec6cb544421e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.012172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce483a7-1668-48fb-a4ae-ec6cb544421e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.012551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce483a7-1668-48fb-a4ae-ec6cb544421e None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.013341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce483a7-1668-48fb-a4ae-ec6cb544421e None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:47.013749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce483a7-1668-48fb-a4ae-ec6cb544421e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.015424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce483a7-1668-48fb-a4ae-ec6cb544421e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:47.024833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:47.025802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:47.026697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:47.026697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:47.026697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:47.026697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 474/944] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:47.032812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.044051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 471/945] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:47.150710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62a359-2b0c-4dc4-ae50-6c004c7a9ef7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.192177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.192794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.193122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.193399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.194056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:47.194357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.195767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.207208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40bdfb-99cb-4d1f-8cfc-45f8a233eb15 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.207508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40bdfb-99cb-4d1f-8cfc-45f8a233eb15 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.207774 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40bdfb-99cb-4d1f-8cfc-45f8a233eb15 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.209413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 472/946] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:47.209950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 475/947] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:47.214522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0b8b-6353-4b9a-b568-b16f6777380d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.214938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0b8b-6353-4b9a-b568-b16f6777380d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.215047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.215181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d0b8b-6353-4b9a-b568-b16f6777380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.246602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9a3d0b8b-6353-4b9a-b568-b16f6777380d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:47.248343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9a3d0b8b-6353-4b9a-b568-b16f6777380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:47.258047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:47.341345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ede323-a5ff-4ffd-b7c5-88eac91663d4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.341852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 473/948] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:47.379984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.380910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.381392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.381846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.388947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.391007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:47.402989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:47.403892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:47.404796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:47.406855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 476/949] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:47.412783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d0b8b-6353-4b9a-b568-b16f6777380d None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.461172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:47.517500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d0b8b-6353-4b9a-b568-b16f6777380d None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.553734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.554352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.554631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.554907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.555603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:47.555943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.557388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.569825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 474/950] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:47.575617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.632686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.688898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189540-2b37-4a33-94a8-79c117b93df6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.693649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:47.728299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.729219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.729590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.729865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/36e0031b7d51472d8580f4897c9c420f/roles/b52cdf8fb6f541d8947b6077b5e598b4` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.732174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=36e0031b7d51472d8580f4897c9c420f, role_id=b52cdf8fb6f541d8947b6077b5e598b4)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.733734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.747010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee9e23-3c7f-4447-aac8-984efdc5ca2e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.751785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 477/951] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:47 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/36e0031b7d51472d8580f4897c9c420f/roles/b52cdf8fb6f541d8947b6077b5e598b4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:47.755358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:47.800026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.801197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.801644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.802093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.803189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.806153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:47.820950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:47.822259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:47.823312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:47.826028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 475/952] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:47.832614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.965230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a255e1-06e8-43cd-84f4-1177dfbe4888 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:48.005041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eede18-874f-44cd-843c-eff4426dceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:48.005927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eede18-874f-44cd-843c-eff4426dceed None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.006348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eede18-874f-44cd-843c-eff4426dceed None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.006785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eede18-874f-44cd-843c-eff4426dceed None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.007579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eede18-874f-44cd-843c-eff4426dceed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:48.008179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eede18-874f-44cd-843c-eff4426dceed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:48.009686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eede18-874f-44cd-843c-eff4426dceed None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:48.015311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 478/953] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:48.020919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:48.134733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4055-22b2-4abe-b393-4864960b92da None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:48.148034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2973-bc78-4742-b69e-9e79b2b95f12 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.148308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2973-bc78-4742-b69e-9e79b2b95f12 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.148605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd2973-bc78-4742-b69e-9e79b2b95f12 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.149932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 479/954] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:48.155111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63ede2-45c1-4960-a802-2424ab4ac3de None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.155397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63ede2-45c1-4960-a802-2424ab4ac3de None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.155677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63ede2-45c1-4960-a802-2424ab4ac3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.175059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4f63ede2-45c1-4960-a802-2424ab4ac3de None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:48.176046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:48.176421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4f63ede2-45c1-4960-a802-2424ab4ac3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:48.176663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.176941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.177211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.177846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:48.178148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:48.180682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:48.194213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 476/955] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:48.195237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:48.201123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:48.245657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:48.262094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 480/956] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:48.319649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc698f-6930-40c6-bca0-694a6fb58434 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:48.353925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:48.354700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.355084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.355458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.356253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:48.357726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:48.385458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 477/957] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:48.540037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63ede2-45c1-4960-a802-2424ab4ac3de None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:48.646140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63ede2-45c1-4960-a802-2424ab4ac3de None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:48.687865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:48.688509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.688787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.689057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] PATH_INFO: `/v3/services/compute` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.690249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:48.691621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:48.700645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:48.701738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:48.702628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 481/958] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:48.710095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:48.806384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:48.817078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afabdd0-8a8b-4ff6-9478-ded1a286a250 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:48.854794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4b1f3-5975-4728-9a5b-67cfde3b8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:48.855552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4b1f3-5975-4728-9a5b-67cfde3b8d98 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.855966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4b1f3-5975-4728-9a5b-67cfde3b8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.856343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4b1f3-5975-4728-9a5b-67cfde3b8d98 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.857081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4b1f3-5975-4728-9a5b-67cfde3b8d98 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:48.857491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4b1f3-5975-4728-9a5b-67cfde3b8d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:48.858967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4b1f3-5975-4728-9a5b-67cfde3b8d98 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:48.864740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 478/959] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:48.870605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:48.884033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:48.988030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08191a11-6586-4664-ae51-cb55408980ca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.024080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9b74e-cd07-4475-af27-09495d9df30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.024696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9b74e-cd07-4475-af27-09495d9df30a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.024976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9b74e-cd07-4475-af27-09495d9df30a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.025249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9b74e-cd07-4475-af27-09495d9df30a None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.025884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9b74e-cd07-4475-af27-09495d9df30a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:49.026190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9b74e-cd07-4475-af27-09495d9df30a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.027553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9b74e-cd07-4475-af27-09495d9df30a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.032691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 482/960] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:49.142048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d04fe-49f2-4e66-a8fc-11f376a30f32 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.142410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d04fe-49f2-4e66-a8fc-11f376a30f32 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.142616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d04fe-49f2-4e66-a8fc-11f376a30f32 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.144849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 479/961] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:49.150470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947368f0-576c-4bf0-80f6-f9e2551d09c9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.150757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947368f0-576c-4bf0-80f6-f9e2551d09c9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.151038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947368f0-576c-4bf0-80f6-f9e2551d09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.172370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-947368f0-576c-4bf0-80f6-f9e2551d09c9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:49.172719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-947368f0-576c-4bf0-80f6-f9e2551d09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:49.251761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 483/962] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:49.534924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d04fe-49f2-4e66-a8fc-11f376a30f32 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.647125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d04fe-49f2-4e66-a8fc-11f376a30f32 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.681817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.682786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.683389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.683897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.684790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.686429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.704170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.sql.core [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:03:49.704170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 16:03:49.704170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [parameters: {'user_id': 'fea26103938d4f04b5b0383db3359570', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 16:03:49.704170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81704) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-06e200fd-48fe-4fa7-9beb-bdc22dd76c1b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result.read() Aug 17 16:03:49.712998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:03:49.714561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application yield resource Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise self.value Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application session.commit() Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:03:49.715552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:03:49.716481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:03:49.717370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application result.read() Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:03:49.718231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fea26103938d4f04b5b0383db3359570', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:49.719066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 16:03:49.721701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 16:03:49.723835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 16:03:49.723835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 16:03:49.723835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:03:49.723835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:03:49.723835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 16:03:49.723835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:49.726531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 480/963] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Aug 17 16:03:49 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:49.732775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947368f0-576c-4bf0-80f6-f9e2551d09c9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.735106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:49.843517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947368f0-576c-4bf0-80f6-f9e2551d09c9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.851668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877573e2-5485-4d8b-87a0-20ab9d713f76 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.851981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877573e2-5485-4d8b-87a0-20ab9d713f76 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.852260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877573e2-5485-4d8b-87a0-20ab9d713f76 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.859654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 481/964] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:49.869503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd8d1-6068-4a62-b26f-e7080e5589f1 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.869788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd8d1-6068-4a62-b26f-e7080e5589f1 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.870063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadd8d1-6068-4a62-b26f-e7080e5589f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.890345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7dadd8d1-6068-4a62-b26f-e7080e5589f1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:49.891333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.891990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7dadd8d1-6068-4a62-b26f-e7080e5589f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:49.892105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.892286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.892539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.901675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.903555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.906073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:49.919312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:49.920517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:49.921812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 484/965] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:49.927082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.998046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 482/966] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:50.016804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.060180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886258a0-b007-481d-8c15-36992e6fb7cb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.096232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c95f48-9411-4d0b-90ef-54fda8b5e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.096752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95f48-9411-4d0b-90ef-54fda8b5e31b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.097030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95f48-9411-4d0b-90ef-54fda8b5e31b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.097301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95f48-9411-4d0b-90ef-54fda8b5e31b None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.098023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c95f48-9411-4d0b-90ef-54fda8b5e31b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:50.098396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c95f48-9411-4d0b-90ef-54fda8b5e31b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.099921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c95f48-9411-4d0b-90ef-54fda8b5e31b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.137301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 485/967] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:50.303102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadd8d1-6068-4a62-b26f-e7080e5589f1 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.408168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0096d5-c342-470e-aa0d-e5381322c833 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.409020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0096d5-c342-470e-aa0d-e5381322c833 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.409304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0096d5-c342-470e-aa0d-e5381322c833 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.410646 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 486/968] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:50.415719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df479-a234-4722-9fcf-5f97467dba5d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.416033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df479-a234-4722-9fcf-5f97467dba5d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.416148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadd8d1-6068-4a62-b26f-e7080e5589f1 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.416325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df479-a234-4722-9fcf-5f97467dba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.434872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1f6df479-a234-4722-9fcf-5f97467dba5d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:50.436089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1f6df479-a234-4722-9fcf-5f97467dba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:50.455720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.456549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.456829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.457102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.467783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:50.473173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:50.474106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:50.474960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 483/969] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:50.480394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.491729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.512333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 487/970] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:50.594902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276dca-ff7a-4923-8316-c2bf8b796894 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.629157 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.629770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.630056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.630331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.630998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:50.631303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.632842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.646884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 484/971] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:50.648043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df479-a234-4722-9fcf-5f97467dba5d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.698792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.749814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df479-a234-4722-9fcf-5f97467dba5d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.787607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.789770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.790418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.790694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.790965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.801905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.803347 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:50.819946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:50.820942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:50.821861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:50.821861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:50.821861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:50.821861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 488/972] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:50.826150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.882278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.917432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8110-18bb-4e16-b8cd-ab6a06630def None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.953075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.953722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.954008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.954281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.954863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.955373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8794c9-9aa0-47a0-830b-8f91c493bb77 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.956533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.957592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:50.965622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:50.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:50.967546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 485/973] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:50.972954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.998103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.998832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.999139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.999388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.000261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:51.000574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.002073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.014860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 489/974] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:51.022097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.084652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2daaf-8f61-4854-94dd-6c3cdca4d173 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.113894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:51.119574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c883416-622f-478c-8adf-e34945476cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.120212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c883416-622f-478c-8adf-e34945476cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.120496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c883416-622f-478c-8adf-e34945476cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.120770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c883416-622f-478c-8adf-e34945476cd7 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.121398 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c883416-622f-478c-8adf-e34945476cd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:51.121703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c883416-622f-478c-8adf-e34945476cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.122307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483f4e-a1d4-407c-a1cf-5305865b1b6c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.123079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c883416-622f-478c-8adf-e34945476cd7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.128486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 486/975] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:51.129639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934200-0c85-4d27-90c4-f95f1f0d1099 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.129924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934200-0c85-4d27-90c4-f95f1f0d1099 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.130198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934200-0c85-4d27-90c4-f95f1f0d1099 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.131411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 487/976] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:51.134029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934200-0c85-4d27-90c4-f95f1f0d1099 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.163420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8acc1-edd7-41ba-a734-c2e9689f4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.164160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8acc1-edd7-41ba-a734-c2e9689f4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.164441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8acc1-edd7-41ba-a734-c2e9689f4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.164713 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8acc1-edd7-41ba-a734-c2e9689f4ff2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.171748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8acc1-edd7-41ba-a734-c2e9689f4ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.173193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8acc1-edd7-41ba-a734-c2e9689f4ff2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1db8acc1-edd7-41ba-a734-c2e9689f4ff2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:51.185333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:51.186466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:51.187508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 490/977] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:03:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:51.188156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5c88-32d2-45d3-978b-ac6c7bb41e3a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.188156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5c88-32d2-45d3-978b-ac6c7bb41e3a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.188373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e5c88-32d2-45d3-978b-ac6c7bb41e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.205939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e66e5c88-32d2-45d3-978b-ac6c7bb41e3a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:51.207143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e66e5c88-32d2-45d3-978b-ac6c7bb41e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:51.223922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:51.238302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934200-0c85-4d27-90c4-f95f1f0d1099 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.271695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.272336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.272618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.272896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.273535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:51.273843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.274571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 491/978] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:51.275226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.275394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5c88-32d2-45d3-978b-ac6c7bb41e3a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.285476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 488/979] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:51.288993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.350913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:51.386269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e5c88-32d2-45d3-978b-ac6c7bb41e3a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.398404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a11283-39b2-46ba-9ad0-16eca1727370 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.422219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.422835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.423113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.423384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.424224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:51.424678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.426096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.433906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.434547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.434913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.435188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.435930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] RBAC: Adding query filter params (interface=admin, service_id=96a74095a38446eaa586588712ebc24d, region_id=RegionOne) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:51.436244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.437604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.442798 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 489/980] 10.222.0.60 () {56 vars in 1249 bytes} [Wed Aug 17 16:03:51 2022] GET /identity/v3/endpoints?service_id=96a74095a38446eaa586588712ebc24d&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:51.447740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 492/981] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Aug 17 16:03:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:51.448382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.448940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.461490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:51.550066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b558d8-49de-45ff-b151-eadada18cb19 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.554599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5011a-8043-4948-b101-ccd0b6f385c9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.572835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:51.584344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.584960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.585251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.585526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.586135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.587516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.589198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.589825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.590101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.590370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.593374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 490/982] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:51 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:03:51.594136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.668216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.669698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.682647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:51.709987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad181b8c-19e2-47ad-a07c-2a33d74f5fa2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.755500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.756080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.756371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.756647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.757304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.758684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.774707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 491/983] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:51 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:51.790720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 493/984] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:03:51.796959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:51.860932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:51.930291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e5a31-e07c-48a4-a9bf-07432c6e5247 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:51.966922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:51.967567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:51.967879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:51.968157 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:51.980321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:51.981777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:51.996684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:51.997973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:51.999168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:51.999168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:51.999168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:51.999168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 492/985] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:52.005818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.110538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c0c5b-faca-4300-81b4-c31afa747120 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:52.122215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:52.147326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:52.147972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.148257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.148530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.149172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:52.149475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:52.150827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:52.171470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 494/986] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:52.173156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.273859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:52.282535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595211-c51d-4de1-a2eb-9b5b0304308e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:52.319375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:52.320050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.320334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.320613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.336292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:52.337795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:52.351385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:52.352388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:52.353297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:52.357540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 493/987] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:52.358778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.461798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df19eb6-a160-417a-94fc-60187f65e2ef None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:52.496278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef892-2d95-4461-a72b-f3541dd82b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:52.497030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef892-2d95-4461-a72b-f3541dd82b6d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.497413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef892-2d95-4461-a72b-f3541dd82b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.497783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef892-2d95-4461-a72b-f3541dd82b6d None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.498570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feef892-2d95-4461-a72b-f3541dd82b6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:52.498975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feef892-2d95-4461-a72b-f3541dd82b6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:52.500503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feef892-2d95-4461-a72b-f3541dd82b6d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:52.514674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 495/988] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:52.521214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.630104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185be20e-d306-4883-ac8c-83f8ebe94045 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:52.664204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b37aa0-cfe0-4f1c-9729-0963a64b50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:52.664959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b37aa0-cfe0-4f1c-9729-0963a64b50fd None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.665339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b37aa0-cfe0-4f1c-9729-0963a64b50fd None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.665719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b37aa0-cfe0-4f1c-9729-0963a64b50fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.666545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b37aa0-cfe0-4f1c-9729-0963a64b50fd None admin] RBAC: Adding query filter params (role.id=b52cdf8fb6f541d8947b6077b5e598b4, scope.project.id=316c09203d964b75a1da935349312a48, user.id=36e0031b7d51472d8580f4897c9c420f) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:52.666959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b37aa0-cfe0-4f1c-9729-0963a64b50fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:52.668559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b37aa0-cfe0-4f1c-9729-0963a64b50fd None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:52.683115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 494/989] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/role_assignments?user.id=36e0031b7d51472d8580f4897c9c420f&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b52cdf8fb6f541d8947b6077b5e598b4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:53.543962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd83c79-2405-454d-8387-c13a5718892a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.544524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd83c79-2405-454d-8387-c13a5718892a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.544524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd83c79-2405-454d-8387-c13a5718892a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.546005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 496/990] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:53.551347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7cd48-edba-4892-b1bc-c3260c5bb3d6 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.551776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7cd48-edba-4892-b1bc-c3260c5bb3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.552135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7cd48-edba-4892-b1bc-c3260c5bb3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.570478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-29f7cd48-edba-4892-b1bc-c3260c5bb3d6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:53.571680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-29f7cd48-edba-4892-b1bc-c3260c5bb3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:53.586488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.643851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 495/991] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:53.777650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441dbbe-046f-40d0-b772-4caa5437bbed None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.777981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441dbbe-046f-40d0-b772-4caa5437bbed None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.778207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441dbbe-046f-40d0-b772-4caa5437bbed None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.779787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 497/992] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:53.785460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f018-dfd4-404c-b063-b1868b794162 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.785742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f018-dfd4-404c-b063-b1868b794162 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.785985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882f018-dfd4-404c-b063-b1868b794162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.804632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4882f018-dfd4-404c-b063-b1868b794162 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:53.805762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4882f018-dfd4-404c-b063-b1868b794162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:53.884247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 496/993] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:53.910523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441dbbe-046f-40d0-b772-4caa5437bbed None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.942390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.017205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441dbbe-046f-40d0-b772-4caa5437bbed None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.052956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.053588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.053867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.054137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.054768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.056100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:54.065425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:54.066444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 16:03:54.067293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:54.071510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 498/994] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:54.072411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f018-dfd4-404c-b063-b1868b794162 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.152498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.154121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.175245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882f018-dfd4-404c-b063-b1868b794162 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.210637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.211252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.211526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.211815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.212451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.212756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.214118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.219359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 497/995] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:54.225705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.259432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.269364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c749e-0142-4b43-aaab-dd15db06c161 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.305549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.306196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.306487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.306764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.307357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.308760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:54.318046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:54.319327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:54.320243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 499/996] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:54.324893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.335464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e57a71-5516-40b7-9061-f26533628f45 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.374734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.375707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.376087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.376431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.377787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.378165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.379613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.387964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 498/997] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:54.392096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.403301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.436084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510dd3a-73d1-430c-8747-40243871c752 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.473651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.474510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.474793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.475068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.475692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.476037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.477394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.483843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 500/998] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:54.488398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.511777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ed005-4493-4c61-9d85-d8863a3addd6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.512695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.550999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05317601-20dd-4813-8e66-d39bb50c309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.551918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05317601-20dd-4813-8e66-d39bb50c309d None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.552880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05317601-20dd-4813-8e66-d39bb50c309d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.553472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05317601-20dd-4813-8e66-d39bb50c309d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.554137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05317601-20dd-4813-8e66-d39bb50c309d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.555510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05317601-20dd-4813-8e66-d39bb50c309d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.573769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 499/999] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:54.602371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3987-0d13-461e-b9b7-8508a5a6dd5f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.620967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860783fb-69f6-4548-afcb-0ce1912398cc None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.621298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860783fb-69f6-4548-afcb-0ce1912398cc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.621586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860783fb-69f6-4548-afcb-0ce1912398cc None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.623438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 500/1000] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:54.630500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b38ae9-c750-4548-a133-7585db988b47 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.630786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b38ae9-c750-4548-a133-7585db988b47 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.631066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b38ae9-c750-4548-a133-7585db988b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.650948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a7b38ae9-c750-4548-a133-7585db988b47 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:54.652237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a7b38ae9-c750-4548-a133-7585db988b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:54.652538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.653167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.653452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.653725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.654381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.654689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.656111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.662443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 501/1001] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:54.668482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.729705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.740024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 501/1002] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:54.763773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.785278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57fec8-e541-47b2-9bec-a3a2caa608f0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.821142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.821759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.822032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.822298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.822990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] RBAC: Adding query filter params (interface=public, service_id=303f9e7dfefa4596a7721e7e96c20b60, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.823294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.826847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.833263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 502/1003] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/endpoints?service_id=303f9e7dfefa4596a7721e7e96c20b60&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:54.838002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b38ae9-c750-4548-a133-7585db988b47 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.943674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b38ae9-c750-4548-a133-7585db988b47 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.979939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.980551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.980829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.981098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.981705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.983078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.990416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 502/1004] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:03:55.002298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.116971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa8250-7d60-49b7-b666-773fdfbe2cc9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.156223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:55.156857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.157128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.157402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.157985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:55.160254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:55.169419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:55.170438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:03:55.171292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 503/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 17 16:03:55 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:55.177172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.241645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:55.282026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb75b07-0b72-4f1f-ae8d-cd897acd06f7 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.317727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5455af-8970-42cc-a046-eb85b892f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:55.318342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5455af-8970-42cc-a046-eb85b892f11d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.318623 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5455af-8970-42cc-a046-eb85b892f11d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.318897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5455af-8970-42cc-a046-eb85b892f11d None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.319524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5455af-8970-42cc-a046-eb85b892f11d None admin] RBAC: Adding query filter params (name=image) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:55.319893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5455af-8970-42cc-a046-eb85b892f11d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:55.321218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5455af-8970-42cc-a046-eb85b892f11d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:55.331571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 503/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:55.332573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.346122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:55.438996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725006fe-cd76-4927-b41b-3409a3d9e6d4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.473316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89477ce0-78f3-4454-902a-91b9b211349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:55.473927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89477ce0-78f3-4454-902a-91b9b211349c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.474208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89477ce0-78f3-4454-902a-91b9b211349c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.474483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89477ce0-78f3-4454-902a-91b9b211349c None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.475111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89477ce0-78f3-4454-902a-91b9b211349c None admin] RBAC: Adding query filter params (type=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:55.475415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89477ce0-78f3-4454-902a-91b9b211349c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:55.476817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89477ce0-78f3-4454-902a-91b9b211349c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:55.488067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 504/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:56.546692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff3fec-cc51-4ab9-94ef-0545816b8ee3 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.547225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff3fec-cc51-4ab9-94ef-0545816b8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.547225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff3fec-cc51-4ab9-94ef-0545816b8ee3 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.548860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 504/1008] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:56.554131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910917-5eb4-48c7-a4e9-df44d0767d54 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.554558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910917-5eb4-48c7-a4e9-df44d0767d54 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.554740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f910917-5eb4-48c7-a4e9-df44d0767d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.572602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6f910917-5eb4-48c7-a4e9-df44d0767d54 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:56.573793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6f910917-5eb4-48c7-a4e9-df44d0767d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:56.643874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 505/1009] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:56.912956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff3fec-cc51-4ab9-94ef-0545816b8ee3 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.938979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1b5e-e127-40bc-9607-2748d911350a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.939301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1b5e-e127-40bc-9607-2748d911350a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.939663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1b5e-e127-40bc-9607-2748d911350a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.941190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 506/1010] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:56.946017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea23c-715c-4c6a-95cb-eb14917c160c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.946306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea23c-715c-4c6a-95cb-eb14917c160c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.946585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea23c-715c-4c6a-95cb-eb14917c160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.955488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:56.966623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f0bea23c-715c-4c6a-95cb-eb14917c160c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:56.968708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f0bea23c-715c-4c6a-95cb-eb14917c160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:57.029659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff3fec-cc51-4ab9-94ef-0545816b8ee3 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.046519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 507/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:57.061725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.071949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.072822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.073254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.073676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.074944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.076569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.078675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 505/1012] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:57.084313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea23c-715c-4c6a-95cb-eb14917c160c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.184923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea23c-715c-4c6a-95cb-eb14917c160c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.224892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf45a5-9dfd-4bb0-a827-c0262bbc91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.225510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf45a5-9dfd-4bb0-a827-c0262bbc91da None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.225787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf45a5-9dfd-4bb0-a827-c0262bbc91da None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.226060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf45a5-9dfd-4bb0-a827-c0262bbc91da None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.227088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf45a5-9dfd-4bb0-a827-c0262bbc91da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.228860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf45a5-9dfd-4bb0-a827-c0262bbc91da None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.235171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.262681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 508/1013] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:57 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:57.325490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.389779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478209ae-527e-4bf1-ae4a-6ae473450b39 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.390067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478209ae-527e-4bf1-ae4a-6ae473450b39 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.390351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478209ae-527e-4bf1-ae4a-6ae473450b39 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.391701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 509/1014] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:57.402028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4f691-c603-4871-b5be-e10abad5e7a4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.402339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4f691-c603-4871-b5be-e10abad5e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.402588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4f691-c603-4871-b5be-e10abad5e7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.424678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-20d4f691-c603-4871-b5be-e10abad5e7a4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:57.425907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-20d4f691-c603-4871-b5be-e10abad5e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:57.442958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a1fe9-53e5-41f6-8a2e-10a7ca9bface None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.482139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.482784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.483156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.483449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.484258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.485443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:57.494958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:57.496049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:03:57.496893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 506/1015] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:57.502528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.509216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 510/1016] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:57.562343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.606937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b611dd-7e8b-44f2-965b-6e6d69187cc4 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.641501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.642118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.642406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.642723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.643531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:57.643859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.645298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.654941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 507/1017] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:57.656243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4f691-c603-4871-b5be-e10abad5e7a4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.761061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4f691-c603-4871-b5be-e10abad5e7a4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.778487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.794331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.800314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994dcc-7851-454a-8442-81c749457696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.800933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994dcc-7851-454a-8442-81c749457696 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.801215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994dcc-7851-454a-8442-81c749457696 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.801493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994dcc-7851-454a-8442-81c749457696 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.802136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994dcc-7851-454a-8442-81c749457696 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:57.802443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994dcc-7851-454a-8442-81c749457696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.803836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994dcc-7851-454a-8442-81c749457696 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.810421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 511/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:57.816430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994dcc-7851-454a-8442-81c749457696 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.911766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242fc9a6-dcd4-484e-a75d-590d47bd5d23 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.925750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994dcc-7851-454a-8442-81c749457696 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.935033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.947862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cba1de-1395-4ead-a0af-270e9ab68084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.948527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cba1de-1395-4ead-a0af-270e9ab68084 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.948815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cba1de-1395-4ead-a0af-270e9ab68084 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.949097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cba1de-1395-4ead-a0af-270e9ab68084 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.949754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cba1de-1395-4ead-a0af-270e9ab68084 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.951135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cba1de-1395-4ead-a0af-270e9ab68084 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.964931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503cdac-7fb9-4b5c-a6d4-70a2d312a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.965798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503cdac-7fb9-4b5c-a6d4-70a2d312a01e None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.966250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503cdac-7fb9-4b5c-a6d4-70a2d312a01e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.966691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503cdac-7fb9-4b5c-a6d4-70a2d312a01e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.966952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 508/1019] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:57 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:57.967728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503cdac-7fb9-4b5c-a6d4-70a2d312a01e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.969284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503cdac-7fb9-4b5c-a6d4-70a2d312a01e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.996665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 512/1020] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:59.217774 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6b4f8-db9e-4233-80bd-c1892e69a905 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.218350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6b4f8-db9e-4233-80bd-c1892e69a905 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.218350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6b4f8-db9e-4233-80bd-c1892e69a905 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.219817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 509/1021] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:59.224831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6667a-4978-49bd-9add-bb7f1da8be89 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.225213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6667a-4978-49bd-9add-bb7f1da8be89 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.225387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6667a-4978-49bd-9add-bb7f1da8be89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.243585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9db6667a-4978-49bd-9add-bb7f1da8be89 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:59.244785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9db6667a-4978-49bd-9add-bb7f1da8be89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:59.275219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:59.321539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 513/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:59.587318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6b4f8-db9e-4233-80bd-c1892e69a905 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:59.691094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6b4f8-db9e-4233-80bd-c1892e69a905 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:59.725066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c69d-b59c-49d8-bbd5-ba59247e5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:59.725694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c69d-b59c-49d8-bbd5-ba59247e5438 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.725971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c69d-b59c-49d8-bbd5-ba59247e5438 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.726242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c69d-b59c-49d8-bbd5-ba59247e5438 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.727340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151c69d-b59c-49d8-bbd5-ba59247e5438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:59.729073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151c69d-b59c-49d8-bbd5-ba59247e5438 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:59.730797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 510/1023] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:59.736320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6667a-4978-49bd-9add-bb7f1da8be89 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:59.841110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6667a-4978-49bd-9add-bb7f1da8be89 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:59.877847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4d12-3e4e-42bb-b669-ec71c1f7e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:59.878472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4d12-3e4e-42bb-b669-ec71c1f7e5ba None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.878752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4d12-3e4e-42bb-b669-ec71c1f7e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.879027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4d12-3e4e-42bb-b669-ec71c1f7e5ba None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.879687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4d12-3e4e-42bb-b669-ec71c1f7e5ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:59.881221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4d12-3e4e-42bb-b669-ec71c1f7e5ba None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:59.903490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 514/1024] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:03:59 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:59.915464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd5b8-bc06-4462-a38a-d6fecd3f24f0 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.915838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd5b8-bc06-4462-a38a-d6fecd3f24f0 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.916069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd5b8-bc06-4462-a38a-d6fecd3f24f0 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.917657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 511/1025] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:59.923304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed452-58ae-4784-b764-c5e47fd52791 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.924166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed452-58ae-4784-b764-c5e47fd52791 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.924465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ed452-58ae-4784-b764-c5e47fd52791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.945065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3f5ed452-58ae-4784-b764-c5e47fd52791 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:59.946288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3f5ed452-58ae-4784-b764-c5e47fd52791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:59.963256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.031893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 515/1026] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:00.058194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742569-dbc1-4809-afc0-76e829343899 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.058474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742569-dbc1-4809-afc0-76e829343899 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.058749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742569-dbc1-4809-afc0-76e829343899 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.060126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 512/1027] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:00.066060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7ec1-bb21-4de2-9680-198ed96c7f13 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.066346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7ec1-bb21-4de2-9680-198ed96c7f13 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.066622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df7ec1-bb21-4de2-9680-198ed96c7f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.085786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-05df7ec1-bb21-4de2-9680-198ed96c7f13 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:00.086976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-05df7ec1-bb21-4de2-9680-198ed96c7f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:00.159499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 516/1028] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:00.304140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742569-dbc1-4809-afc0-76e829343899 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.357989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.412405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742569-dbc1-4809-afc0-76e829343899 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.431228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df7ec1-bb21-4de2-9680-198ed96c7f13 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.447190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.447842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.448130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.448407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] PATH_INFO: `/v3/services/image` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.449004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.450380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:00.460268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:00.461313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:00.462173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 513/1029] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:00.467195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.516416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.545715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df7ec1-bb21-4de2-9680-198ed96c7f13 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.572968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a2591-b24d-4edb-85f3-05b8b2f9ff99 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.582774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.583446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.583725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.584032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.589352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.594924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:00.600618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:00.601557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:00.602397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 517/1030] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:00.607773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.615260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.616088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.616620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.617031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.617811 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:00.618268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.619928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.625870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 514/1031] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:00.631732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.718644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a438-23b5-4cfc-8d1d-5138728d2ec5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.739469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728531d-54ca-4b9e-9f64-cad51749ddc3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.755035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.755650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.755964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.756241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.756918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:00.757227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.758594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.764318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.769779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 518/1032] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:00.774228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.776959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.777577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.777863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.778141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.778775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] RBAC: Adding query filter params (type=image) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:00.779081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.780501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.791248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 515/1033] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:00.792411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.851666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.885932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b952e9c-318b-4b19-863c-8186c5715102 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.921997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0755ea-a454-4061-8aa9-98c90014402c None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.923077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.923834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.924134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.924409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.935829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.937394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:00.952753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:00.954114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:00.955105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:00.955105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:00.955105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:00.955105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 519/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:00.960040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.960618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.961241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.961527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.961807 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.962518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] RBAC: Adding query filter params (interface=public, service_id=563a1194835b4535b69f18e37a1e693d, region_id=RegionOne) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:00.962838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.964260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.969610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 516/1035] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/endpoints?service_id=563a1194835b4535b69f18e37a1e693d&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:00.976156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:01.019961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:01.072717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2a4f-c789-4eea-9b35-9b2c24d4837b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:01.097652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfccec4-c5d2-4e0c-9655-c4e8406ea1ac None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:01.105336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:01.113234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:01.114123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.114404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.114676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.115479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:01.115784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:01.117443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:01.131843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 520/1036] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:01.137080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:01.138008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:01.138629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.138911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.139186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.139895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:01.141304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:01.155843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 517/1037] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:04:01.258774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f628d-ba17-4260-bd45-a153696421fd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:01.273746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:01.297466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:01.298108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.298387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.298817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.307782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:01.309298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:04:01.322190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:01.323339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:01.324390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 521/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:04:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:01.329161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:01.436121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89179b4-d039-4b05-9983-12ea060e0339 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:01.472106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:01.472728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.473006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.473277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.474003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:01.474308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:01.475736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:01.498363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 518/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:04:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:01.499917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:01.604436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e8fb-1bbd-4f23-bbc0-99707abee7b6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:01.639022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84addf-efca-4824-89a8-5b1131b9ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:01.639637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84addf-efca-4824-89a8-5b1131b9ee69 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.639980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84addf-efca-4824-89a8-5b1131b9ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.640264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84addf-efca-4824-89a8-5b1131b9ee69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.682558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:01.712029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84addf-efca-4824-89a8-5b1131b9ee69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:01.713470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84addf-efca-4824-89a8-5b1131b9ee69 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:01.816324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 522/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:01.821724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:01.850726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:01.922492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706999-fd65-4c9d-9a00-b1980db3fae0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.922678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706999-fd65-4c9d-9a00-b1980db3fae0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.922955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706999-fd65-4c9d-9a00-b1980db3fae0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.925122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 523/1041] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:01.925516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4593e0-8829-404d-b0cb-07069b88f9e0 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:01.929964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8679d9-33e4-4af8-a035-477519349acf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.930258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8679d9-33e4-4af8-a035-477519349acf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.930535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8679d9-33e4-4af8-a035-477519349acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.948872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6e8679d9-33e4-4af8-a035-477519349acf None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:01.950072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6e8679d9-33e4-4af8-a035-477519349acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:01.960641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:01.961284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.961568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.961867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.972871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:01.974324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:01.989467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:01.990425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:01.996481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:01.996481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:01.996481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:01.996481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 519/1042] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:01.996481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.026996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 524/1043] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:04:02.081796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:02.102461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d006e5e-aed5-4a1e-978b-cd0637409406 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.136655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.137269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.137551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.137827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.138475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:02.138779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:02.140186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:02.154487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 520/1044] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:02.160298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8679d9-33e4-4af8-a035-477519349acf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.162881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:02.267012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8679d9-33e4-4af8-a035-477519349acf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.298526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.301708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.302351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.302632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.302908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.309737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:02.311170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:04:02.323171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:02.324172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:02.325435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 525/1045] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:02.330863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.393181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:02.408477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34176-7437-47be-969d-22700b4527eb None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.436529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033651e-46e3-4b87-8b71-80b854e5e438 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.446598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.447247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.447530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.447824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.455585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:02.459493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:02.464639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:02.465551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:02.466393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 521/1046] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:02.472504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.474252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.474871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.475150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.475422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.476157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:02.476463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:02.477885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:02.491605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 526/1047] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:02.497361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.576130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c7ed0-08aa-4980-bea8-d8c2b40e520d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.598902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b293c-1db3-44c0-935b-ddaea166508c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.612422 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.613239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.613683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.613959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.614638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:02.614946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:02.616428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:02.622643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:02.625175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 522/1048] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:02.631752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.636797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.637410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.637688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.637960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.638717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] RBAC: Adding query filter params (role.id=b52cdf8fb6f541d8947b6077b5e598b4, scope.project.id=316c09203d964b75a1da935349312a48, user.id=352b7e4d311d491f8e665d4cf7e554b8) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:02.639022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:02.640487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:02.646445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 527/1049] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:02 2022] GET /identity/v3/role_assignments?user.id=352b7e4d311d491f8e665d4cf7e554b8&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b52cdf8fb6f541d8947b6077b5e598b4 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:02.699454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:02.743940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1ecc5-8fb8-4c4e-9598-f3d127a6d190 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.786053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba03604-0de9-4612-b4e9-d2f63316099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.787088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba03604-0de9-4612-b4e9-d2f63316099a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.787088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba03604-0de9-4612-b4e9-d2f63316099a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.787255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba03604-0de9-4612-b4e9-d2f63316099a None admin] PATH_INFO: `/v3/users/bdb9eccb576443d3b9444edd73eed801` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.802456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba03604-0de9-4612-b4e9-d2f63316099a None admin] RBAC: Authorizing `identity:get_user(user_id=bdb9eccb576443d3b9444edd73eed801)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:02.803948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba03604-0de9-4612-b4e9-d2f63316099a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:02.805819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 523/1050] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:02 2022] GET /identity/v3/users/bdb9eccb576443d3b9444edd73eed801 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:02.811860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.920524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7077a-5c3a-4944-829e-b358514725ed None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.954275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.954942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.955219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.955490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.011562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:03.025790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:03.027231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:03.097122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e252-8cf8-4e37-afa7-55a08986cb21 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.097408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e252-8cf8-4e37-afa7-55a08986cb21 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.097596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828e252-8cf8-4e37-afa7-55a08986cb21 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.098946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 524/1051] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:03.104035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3cd47-3786-46c7-aba9-539242ab067a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.104320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3cd47-3786-46c7-aba9-539242ab067a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.104601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3cd47-3786-46c7-aba9-539242ab067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.123417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cff3cd47-3786-46c7-aba9-539242ab067a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:03.124639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cff3cd47-3786-46c7-aba9-539242ab067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:03.132274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 528/1052] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:03.138192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:03.200059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 525/1053] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:04:03.222058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:03.237858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057949-fd09-415a-a20b-14a929f3eed0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:03.272111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:03.272747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.273028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.273298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.274423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=332a572331234f3d912cfdc615323cb5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:03.275909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:03.277552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 529/1054] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:03 2022] GET /identity/v3/projects/332a572331234f3d912cfdc615323cb5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:03.284787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3cd47-3786-46c7-aba9-539242ab067a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:03.340235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:03.390965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3cd47-3786-46c7-aba9-539242ab067a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:03.424608 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:03.425207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.425475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.425749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.426471 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=332a572331234f3d912cfdc615323cb5, user.id=bdb9eccb576443d3b9444edd73eed801) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:03.426776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:03.428237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:03.433543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 526/1055] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:03 2022] GET /identity/v3/role_assignments?user.id=bdb9eccb576443d3b9444edd73eed801&scope.project.id=332a572331234f3d912cfdc615323cb5&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:03.482055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:03.591353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf78636-0be3-401f-ae12-9a6513934cb4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:03.628771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:03.629402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.629664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.629938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] PATH_INFO: `/v3/services/image` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.630520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:03.631893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:03.640749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:03.641802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:03.642751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 530/1056] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Aug 17 16:04:03 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:03.649525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:03.754328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67aa1-a893-4bca-b78a-06bb763a052e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:03.768407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:03.790274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:03.790884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.791161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.791430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.792089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] RBAC: Adding query filter params (name=image) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:03.792393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:03.793757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:03.804002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 527/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:03.805156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:03.831121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:03.918522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac367e-c354-4c72-8db2-9e94c37aac1c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:03.951920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac8638-1acf-4fbb-8821-892a57c5dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:03.952528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8638-1acf-4fbb-8821-892a57c5dd80 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.952806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8638-1acf-4fbb-8821-892a57c5dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.953078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac8638-1acf-4fbb-8821-892a57c5dd80 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.953703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac8638-1acf-4fbb-8821-892a57c5dd80 None admin] RBAC: Adding query filter params (type=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:03.954002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac8638-1acf-4fbb-8821-892a57c5dd80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:03.955535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac8638-1acf-4fbb-8821-892a57c5dd80 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:03.965042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 531/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:03.966221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:04.069229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1531b2-f139-447e-afef-ea110d689d44 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:04.113229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d80fd3-6e5b-4c21-bb01-b47666fa0998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:04.113848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d80fd3-6e5b-4c21-bb01-b47666fa0998 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:04.114126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d80fd3-6e5b-4c21-bb01-b47666fa0998 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:04.114395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d80fd3-6e5b-4c21-bb01-b47666fa0998 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:04.115076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d80fd3-6e5b-4c21-bb01-b47666fa0998 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:04.116530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d80fd3-6e5b-4c21-bb01-b47666fa0998 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:04.147840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 528/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:04:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:04:04.592753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69e9c-3613-4aa6-9de8-1277460143d4 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:04.593087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69e9c-3613-4aa6-9de8-1277460143d4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:04.593307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69e9c-3613-4aa6-9de8-1277460143d4 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:04.594797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 532/1060] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:04.600008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7267-7664-4ad7-866d-9257a9ef3cab None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:04.600462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7267-7664-4ad7-866d-9257a9ef3cab None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:04.600627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7267-7664-4ad7-866d-9257a9ef3cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:04.618891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-af1c7267-7664-4ad7-866d-9257a9ef3cab None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:04.620105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-af1c7267-7664-4ad7-866d-9257a9ef3cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:04.648542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:04.699148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 529/1061] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:04.971836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f69e9c-3613-4aa6-9de8-1277460143d4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.058306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.079503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f69e9c-3613-4aa6-9de8-1277460143d4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.114419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.115051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.115325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.115591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.126193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:05.131931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:05.132884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:04:05.133740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:05.137906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 533/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 17 16:04:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:05.139160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c7267-7664-4ad7-866d-9257a9ef3cab None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.242099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c7267-7664-4ad7-866d-9257a9ef3cab None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.275934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134646e1-b444-46ac-be2d-dbd390bbe57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.276550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134646e1-b444-46ac-be2d-dbd390bbe57c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.276829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134646e1-b444-46ac-be2d-dbd390bbe57c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.277097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134646e1-b444-46ac-be2d-dbd390bbe57c None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.277757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134646e1-b444-46ac-be2d-dbd390bbe57c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:05.278057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134646e1-b444-46ac-be2d-dbd390bbe57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.279419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134646e1-b444-46ac-be2d-dbd390bbe57c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.292837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 530/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:05.294412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.365954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f17ac-7282-427d-b062-2293593e8a2a None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.366294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f17ac-7282-427d-b062-2293593e8a2a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.366525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f17ac-7282-427d-b062-2293593e8a2a None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.367909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 531/1064] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:05.372705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6bbb-72bf-4f3c-a88a-5dde9f2518f4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.373098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6bbb-72bf-4f3c-a88a-5dde9f2518f4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.373384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6bbb-72bf-4f3c-a88a-5dde9f2518f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.393402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-611f6bbb-72bf-4f3c-a88a-5dde9f2518f4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:05.394717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-611f6bbb-72bf-4f3c-a88a-5dde9f2518f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:05.404364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20709bea-5335-477e-b652-8e6b181bef9a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.419328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.443182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.443835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.444122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.444395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.455471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.457138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.458969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:05.472824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:05.473795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:05.475397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:05.475397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:05.475397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:05.475397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 534/1065] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:05.477270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 532/1066] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:04:05.482422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.584302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f15337-d0c0-4d74-ad7b-487d31004d5f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.618174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.618786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.619067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.619339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.620005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:05.620311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.621664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.637763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 535/1067] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:05.639507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f6bbb-72bf-4f3c-a88a-5dde9f2518f4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.743238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f6bbb-72bf-4f3c-a88a-5dde9f2518f4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.744940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.782099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.783344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.783770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.784289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.792683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.794166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:04:05.808716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:05.809665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 533/1068] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:05.817127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.819768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.834987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.882586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aad541-7444-4114-8d63-913a56f27286 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.923148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.924482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.924829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.925112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.927165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fa0a5-aef8-459b-b8e9-a1fb3e0f0078 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.935617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:05.940559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:05.941493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:05.942331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 536/1069] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:05.947534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.965954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.967086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.967888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.968403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.969400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:05.969933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.972748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.998490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 534/1070] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:06.004553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.061476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4dc5f-a515-46e4-9029-2431a5db0707 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.075999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.083461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.100277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.100825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.101109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.101387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.102062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:06.102370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.104096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.113874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 537/1071] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:06.119272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.123324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6ce7-ca98-42d6-b760-0852af1982aa None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.161612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe1a3e-c79f-4cf2-8537-9900ae639bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.162252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1a3e-c79f-4cf2-8537-9900ae639bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.162530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1a3e-c79f-4cf2-8537-9900ae639bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.162803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe1a3e-c79f-4cf2-8537-9900ae639bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.173182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe1a3e-c79f-4cf2-8537-9900ae639bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.175188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe1a3e-c79f-4cf2-8537-9900ae639bc2 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-a5fe1a3e-c79f-4cf2-8537-9900ae639bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:06.189900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:06.190914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:06.191854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:06.191854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:06.191854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:06.191854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 535/1072] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:06.192562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620618-a34c-4aeb-ac6e-8f0f03eabdd4 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.192841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620618-a34c-4aeb-ac6e-8f0f03eabdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.193112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75620618-a34c-4aeb-ac6e-8f0f03eabdd4 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.194464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 536/1073] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:06.196570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620618-a34c-4aeb-ac6e-8f0f03eabdd4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.223544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8945c86-22c7-4d47-842e-9220ffc57ab9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.257717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee867c3-4f9d-46b4-9467-e151eb0e2696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.258344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee867c3-4f9d-46b4-9467-e151eb0e2696 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.258623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee867c3-4f9d-46b4-9467-e151eb0e2696 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.258895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee867c3-4f9d-46b4-9467-e151eb0e2696 None admin] PATH_INFO: `/v3/users/bdb9eccb576443d3b9444edd73eed801` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.260037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee867c3-4f9d-46b4-9467-e151eb0e2696 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb9eccb576443d3b9444edd73eed801)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.261447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee867c3-4f9d-46b4-9467-e151eb0e2696 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.262999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 538/1074] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/users/bdb9eccb576443d3b9444edd73eed801 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:06.267780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e0565-dd6c-47f5-992e-d3219468a2e6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.268570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e0565-dd6c-47f5-992e-d3219468a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.268853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e0565-dd6c-47f5-992e-d3219468a2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.286612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a78e0565-dd6c-47f5-992e-d3219468a2e6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:06.287819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a78e0565-dd6c-47f5-992e-d3219468a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:06.298048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75620618-a34c-4aeb-ac6e-8f0f03eabdd4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.323540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.327206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.337260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.337867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.338144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.338421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.339063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:06.339364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.340765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.358121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 537/1075] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:06.358121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.365777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 539/1076] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:06.367205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e0565-dd6c-47f5-992e-d3219468a2e6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.458106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789d1e1-cef0-4e62-b54e-ca5bb8770359 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.475062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e0565-dd6c-47f5-992e-d3219468a2e6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.494972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.495726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.496036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.496315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.497447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] RBAC: Authorizing `identity:get_project(project_id=332a572331234f3d912cfdc615323cb5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.499153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.506318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 538/1077] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/projects/332a572331234f3d912cfdc615323cb5 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:06.507142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.509345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.509986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.510271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.510550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.517873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.519311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:04:06.530756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:06.531706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:06.532761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:06.533986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 540/1078] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:06.539525 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.566555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.574667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.627019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27336-d325-43a9-824c-5fe22b2242d9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.644224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96337565-7b25-45ed-8fe7-bd50c9bd0e4d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.662879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.663543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.663839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.664122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5/users/bdb9eccb576443d3b9444edd73eed801/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.666024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] RBAC: Authorizing `identity:create_grant(project_id=332a572331234f3d912cfdc615323cb5, user_id=bdb9eccb576443d3b9444edd73eed801, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.667449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.678689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.679298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.679582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.679889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.687584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 539/1079] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:04:06 2022] PUT /identity/v3/projects/332a572331234f3d912cfdc615323cb5/users/bdb9eccb576443d3b9444edd73eed801/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:04:06.687853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:06.687853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.688033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.688120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.696440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 541/1080] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:06.702561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.803652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.808023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffbfc3-96e2-4a48-8139-be57ff0075ec None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.811580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3f15c-f25a-432c-9b81-1acb96e63175 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.822975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.858288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.858823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.858955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.859165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.859438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.860098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.860516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.861564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/352b7e4d311d491f8e665d4cf7e554b8/roles/b52cdf8fb6f541d8947b6077b5e598b4` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.865020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=352b7e4d311d491f8e665d4cf7e554b8, role_id=b52cdf8fb6f541d8947b6077b5e598b4)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.866607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.881485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 542/1081] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:04:06 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/352b7e4d311d491f8e665d4cf7e554b8/roles/b52cdf8fb6f541d8947b6077b5e598b4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:04:06.939693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.941675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:07.058489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 540/1082] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:07.064429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:07.166434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d3cd9-7abc-4bdf-866d-aad4579eeb66 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:07.201277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92ac4f-c770-4758-bd5f-fda767bee602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:07.202454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ac4f-c770-4758-bd5f-fda767bee602 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:07.202732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ac4f-c770-4758-bd5f-fda767bee602 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:07.202997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92ac4f-c770-4758-bd5f-fda767bee602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:07.214542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ac4f-c770-4758-bd5f-fda767bee602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:07.216006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92ac4f-c770-4758-bd5f-fda767bee602 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-bb92ac4f-c770-4758-bd5f-fda767bee602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:07.231765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:07.232798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:07.233705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:07.233705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:07.233705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:07.233705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 543/1083] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:07.240238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:07.252316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:07.344187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52d2fa-a02f-4a44-a823-1d30a3a53e1a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:07.380941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacac425-51af-494e-adc2-210bda149496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:07.381552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac425-51af-494e-adc2-210bda149496 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:07.381834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac425-51af-494e-adc2-210bda149496 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:07.382106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacac425-51af-494e-adc2-210bda149496 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:07.382748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac425-51af-494e-adc2-210bda149496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:07.383059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac425-51af-494e-adc2-210bda149496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:07.384610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacac425-51af-494e-adc2-210bda149496 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:07.396976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 541/1084] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:08.615046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914861-2d79-4ca6-a33d-f33833f332a7 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.615584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914861-2d79-4ca6-a33d-f33833f332a7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.615584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd914861-2d79-4ca6-a33d-f33833f332a7 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.616971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 544/1085] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:08.622077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a594904-ed1e-49e3-ae42-5a1ee033afc9 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.622459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a594904-ed1e-49e3-ae42-5a1ee033afc9 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.622640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a594904-ed1e-49e3-ae42-5a1ee033afc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.641042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5a594904-ed1e-49e3-ae42-5a1ee033afc9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:08.642969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5a594904-ed1e-49e3-ae42-5a1ee033afc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:08.709324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:08.715940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 542/1086] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:08.840463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c3895-65db-4d38-b1c5-b5df837f7bc3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.840751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c3895-65db-4d38-b1c5-b5df837f7bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.841023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c3895-65db-4d38-b1c5-b5df837f7bc3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.842362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 545/1087] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:08.848194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0cc36-a7d9-4f18-8ff1-9f8616ec5e38 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.848488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0cc36-a7d9-4f18-8ff1-9f8616ec5e38 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.848774 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0cc36-a7d9-4f18-8ff1-9f8616ec5e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.867129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-8fc0cc36-a7d9-4f18-8ff1-9f8616ec5e38 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:08.868288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8fc0cc36-a7d9-4f18-8ff1-9f8616ec5e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:08.933467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 543/1088] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:08.987514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c3895-65db-4d38-b1c5-b5df837f7bc3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:08.997101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.093764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c3895-65db-4d38-b1c5-b5df837f7bc3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.128016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.128584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.128870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.129144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.139554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:09.144391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:09.147883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:09.148964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 546/1089] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:09.151482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0cc36-a7d9-4f18-8ff1-9f8616ec5e38 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.212950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.253652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0cc36-a7d9-4f18-8ff1-9f8616ec5e38 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.279650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.284109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.290209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.290832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.291111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.291387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.292098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:09.292410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.293882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.302201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 544/1090] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:09.308586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.325055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27620c3f-8537-4e50-b054-3e0de03dcb13 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.365193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.365824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.366103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.366374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.376366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:09.381619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:09.382707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:09.384014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 547/1091] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:09.388542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.410996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068cb0d-5120-4729-9f00-975689ccac59 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.445597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.446607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.446899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.447177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] PATH_INFO: `/v3/users/bdb9eccb576443d3b9444edd73eed801` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.448431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb9eccb576443d3b9444edd73eed801)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.450383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.452001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 545/1092] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/users/bdb9eccb576443d3b9444edd73eed801 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:09.458773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.491554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb0fec-89b1-466a-a4e6-d16b39364512 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.516481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.516788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.526607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.527206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.527480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.527754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.528435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:09.529408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.530068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.543297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 548/1093] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:09.544738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.558278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5f4b-95a9-41f3-9b80-b58aaa0fae03 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.590948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.591552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.591922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.592197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.647552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc2ec4-ad19-4773-af14-39b9e4899adf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.659138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.660615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.681445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03196330-b679-4625-8152-b575adce1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.682062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03196330-b679-4625-8152-b575adce1185 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.682338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03196330-b679-4625-8152-b575adce1185 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.682609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03196330-b679-4625-8152-b575adce1185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.693237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03196330-b679-4625-8152-b575adce1185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.694659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03196330-b679-4625-8152-b575adce1185 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-03196330-b679-4625-8152-b575adce1185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:09.709020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:09.710146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:09.711180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:09.711180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:09.711180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:09.711180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 549/1094] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:09.715887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03196330-b679-4625-8152-b575adce1185 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.716945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.759309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.760734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 546/1095] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:04:09.766509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.822105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03196330-b679-4625-8152-b575adce1185 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.862425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.863218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.863500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.863786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.864443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:09.864743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.865279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3f9d-ccab-45ec-a9c6-0681e06a81ad None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.866086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.878883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 550/1096] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:09.884596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.899501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.900104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.900387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.900664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.901773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] RBAC: Authorizing `identity:get_project(project_id=332a572331234f3d912cfdc615323cb5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.903216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.910566 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 547/1097] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/projects/332a572331234f3d912cfdc615323cb5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:09.911523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.939256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.983156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.987763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcab9ba-816d-4f68-b450-c44c2d702822 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.012843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1434f-e9a2-476b-bbe1-9dbb156f71cd None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.022235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.022868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.023179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.023463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.030427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.031937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:04:10.044754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:10.045716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:10.046676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 551/1098] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:10.049489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.050101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.050382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.050657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.051450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=332a572331234f3d912cfdc615323cb5, user.id=bdb9eccb576443d3b9444edd73eed801) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:10.051764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.051918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:10.053235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.059150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 548/1099] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/role_assignments?user.id=bdb9eccb576443d3b9444edd73eed801&scope.project.id=332a572331234f3d912cfdc615323cb5&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:10.163015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fb491-4826-4fcf-b716-3d46348c899e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.198162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.198785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.199065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.199341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.200119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:10.200427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.201855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.222034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 552/1100] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Aug 17 16:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:10.228031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:10.320152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:10.329982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784787e1-5534-4d83-8bbe-65e6f9daafc1 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.367381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.368017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.368299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.368568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.435936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.437303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.524777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:10.535574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 549/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:10.541319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:10.561092 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:10.643027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f941a8-9efc-439c-a65c-8024dae3d148 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.676288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.676920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.677201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.677476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.687522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.689806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:10.703933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:10.705628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:10.706556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:10.706556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:10.706556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:10.706556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 553/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:10.711521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:10.808988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966036-5f27-4cde-9b15-3239efd61bb3 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.842887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.843499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.843782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.844087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.844739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:10.845663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.847038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.858356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 550/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:10.864133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:10.935579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:10.967854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd76c1-3efc-40bc-bfcb-e0c50666624b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:11.000989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:11.001782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:11.002078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:11.002355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:11.008965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:11.010393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:04:11.022241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:11.023322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:11.028999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 554/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:11.029480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:11.082403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:11.129890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113250-cf22-4605-80ae-66ee0a651c01 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:11.163448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df868-f50a-468f-9910-776ad06f13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:11.164116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df868-f50a-468f-9910-776ad06f13c7 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:11.164402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df868-f50a-468f-9910-776ad06f13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:11.164678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df868-f50a-468f-9910-776ad06f13c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:11.165394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df868-f50a-468f-9910-776ad06f13c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:11.165706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df868-f50a-468f-9910-776ad06f13c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:11.167191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55df868-f50a-468f-9910-776ad06f13c7 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:11.180272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 551/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:11.186340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:11.285065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8d08-8a38-4e3f-b545-f6156f08943e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:11.312289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:11.319351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f1183-cbc3-48c9-abc7-bc0e0da06280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:11.319983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f1183-cbc3-48c9-abc7-bc0e0da06280 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:11.320268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f1183-cbc3-48c9-abc7-bc0e0da06280 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:11.320539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f1183-cbc3-48c9-abc7-bc0e0da06280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:11.321265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f1183-cbc3-48c9-abc7-bc0e0da06280 None admin] RBAC: Adding query filter params (role.id=b52cdf8fb6f541d8947b6077b5e598b4, scope.project.id=316c09203d964b75a1da935349312a48, user.id=352b7e4d311d491f8e665d4cf7e554b8) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:11.321577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f1183-cbc3-48c9-abc7-bc0e0da06280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:11.322989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f1183-cbc3-48c9-abc7-bc0e0da06280 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:11.328928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 555/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:11 2022] GET /identity/v3/role_assignments?user.id=352b7e4d311d491f8e665d4cf7e554b8&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b52cdf8fb6f541d8947b6077b5e598b4 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:12.010264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdecd17-c241-460b-9613-bd8bd0033690 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.010800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdecd17-c241-460b-9613-bd8bd0033690 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.011016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdecd17-c241-460b-9613-bd8bd0033690 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.013000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 552/1107] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:12.018503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5e427-0ae5-475f-9b6a-cc862d6bbbc8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.018945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5e427-0ae5-475f-9b6a-cc862d6bbbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.019057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5e427-0ae5-475f-9b6a-cc862d6bbbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.040725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4ce5e427-0ae5-475f-9b6a-cc862d6bbbc8 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:12.041941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4ce5e427-0ae5-475f-9b6a-cc862d6bbbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:12.124527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 556/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:12.422916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdecd17-c241-460b-9613-bd8bd0033690 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:12.542128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdecd17-c241-460b-9613-bd8bd0033690 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:12.557435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:12.581661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c45ac-86a5-49de-89b4-894946f85716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:12.582290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c45ac-86a5-49de-89b4-894946f85716 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.582569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c45ac-86a5-49de-89b4-894946f85716 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.582839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c45ac-86a5-49de-89b4-894946f85716 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.584193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c45ac-86a5-49de-89b4-894946f85716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:12.585439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c45ac-86a5-49de-89b4-894946f85716 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:12.587009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 553/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:12.593215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5e427-0ae5-475f-9b6a-cc862d6bbbc8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:12.714148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5e427-0ae5-475f-9b6a-cc862d6bbbc8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:12.736891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:12.748374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69bc89-2927-423a-8e9c-27ac29f9caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:12.748979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69bc89-2927-423a-8e9c-27ac29f9caff None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.749255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69bc89-2927-423a-8e9c-27ac29f9caff None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.749525 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69bc89-2927-423a-8e9c-27ac29f9caff None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.750163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69bc89-2927-423a-8e9c-27ac29f9caff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:12.752191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69bc89-2927-423a-8e9c-27ac29f9caff None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:12.772519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 557/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:04:12 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:04:14.737228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae200e-efbd-415a-b4b8-1d1cfdcc3fd7 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:14.737871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae200e-efbd-415a-b4b8-1d1cfdcc3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:14.737871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae200e-efbd-415a-b4b8-1d1cfdcc3fd7 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:14.739100 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 554/1111] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:14.744311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67ad47-95a0-4810-a428-4b0034a9983b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:14.744714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67ad47-95a0-4810-a428-4b0034a9983b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:14.744859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67ad47-95a0-4810-a428-4b0034a9983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:14.763215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1e67ad47-95a0-4810-a428-4b0034a9983b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:14.764436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1e67ad47-95a0-4810-a428-4b0034a9983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:14.828654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 558/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:15.105739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae200e-efbd-415a-b4b8-1d1cfdcc3fd7 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:15.204708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae200e-efbd-415a-b4b8-1d1cfdcc3fd7 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:15.238937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:15.239560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.239873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.240149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] PATH_INFO: `/v3/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.241519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] RBAC: Authorizing `identity:get_role(role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:15.242882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:15.244208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 555/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:15 2022] GET /identity/v3/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:15.250033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67ad47-95a0-4810-a428-4b0034a9983b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:15.346731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67ad47-95a0-4810-a428-4b0034a9983b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:15.357329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:15.382225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:15.382844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.383133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.383400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] PATH_INFO: `/v3/users/e5acf091244746c990d8a505027d1690` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.396030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] RBAC: Authorizing `identity:get_user(user_id=e5acf091244746c990d8a505027d1690)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:15.397469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:15.399029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 559/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:15 2022] GET /identity/v3/users/e5acf091244746c990d8a505027d1690 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:15.404783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:15.452868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:15.503681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732dcc4-80d9-494f-921b-ea88f8157cb8 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:15.535725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:15.536353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.536630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.536901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.601201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:15.602637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:15.648783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:15.699122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 556/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:15.705120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:15.802418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f0af-5943-4ed7-8ff8-aee9a292a6bb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:15.835247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81495-f875-4506-8bec-a14beeeeb75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:15.835904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81495-f875-4506-8bec-a14beeeeb75c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.836185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81495-f875-4506-8bec-a14beeeeb75c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.836461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81495-f875-4506-8bec-a14beeeeb75c None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.837871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81495-f875-4506-8bec-a14beeeeb75c None admin] RBAC: Authorizing `identity:get_project(project_id=332a572331234f3d912cfdc615323cb5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:15.838994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81495-f875-4506-8bec-a14beeeeb75c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:15.840638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 560/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:15 2022] GET /identity/v3/projects/332a572331234f3d912cfdc615323cb5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:15.847377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:15.942702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9482a8-078e-4452-979e-7baba3fbacd9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:15.975559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1a805-a524-4ef1-8013-bc2be7a403a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:15.976182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a805-a524-4ef1-8013-bc2be7a403a5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.976460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a805-a524-4ef1-8013-bc2be7a403a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.976730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a805-a524-4ef1-8013-bc2be7a403a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.977449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1a805-a524-4ef1-8013-bc2be7a403a5 None admin] RBAC: Adding query filter params (role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=332a572331234f3d912cfdc615323cb5, user.id=e5acf091244746c990d8a505027d1690) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:15.977755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1a805-a524-4ef1-8013-bc2be7a403a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:15.979451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1a805-a524-4ef1-8013-bc2be7a403a5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:15.984608 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 557/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:15 2022] GET /identity/v3/role_assignments?user.id=e5acf091244746c990d8a505027d1690&scope.project.id=332a572331234f3d912cfdc615323cb5&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:17.840727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39e3a-e2ac-4998-b0a8-b5631a29fd93 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:17.841181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39e3a-e2ac-4998-b0a8-b5631a29fd93 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:17.841280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a39e3a-e2ac-4998-b0a8-b5631a29fd93 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:17.842610 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 561/1118] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:17.848582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d689-9ed3-40e4-aa05-905441645452 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:17.849003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d689-9ed3-40e4-aa05-905441645452 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:17.849136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122d689-9ed3-40e4-aa05-905441645452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:17.866973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7122d689-9ed3-40e4-aa05-905441645452 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:17.868188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7122d689-9ed3-40e4-aa05-905441645452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:17.875365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:17.933316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 558/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:18.198886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39e3a-e2ac-4998-b0a8-b5631a29fd93 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:18.235211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:18.300208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a39e3a-e2ac-4998-b0a8-b5631a29fd93 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:18.333865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:18.334477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:18.334756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:18.335026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] PATH_INFO: `/v3/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:18.336425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] RBAC: Authorizing `identity:get_role(role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:18.337776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:18.339061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 562/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:18 2022] GET /identity/v3/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:18.344868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122d689-9ed3-40e4-aa05-905441645452 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:18.440876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122d689-9ed3-40e4-aa05-905441645452 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:18.472616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:18.473171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:18.473449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:18.473718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] PATH_INFO: `/v3/users/e5acf091244746c990d8a505027d1690` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:18.474820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=e5acf091244746c990d8a505027d1690)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:18.476270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:18.477805 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 559/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:18 2022] GET /identity/v3/users/e5acf091244746c990d8a505027d1690 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:18.483685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:18.581093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a885d-eb82-4cba-9791-6ecc69be011f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:18.583396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:18.615596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311905f-748b-4fcf-8955-982ca1700d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:18.616239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311905f-748b-4fcf-8955-982ca1700d72 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:18.616518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311905f-748b-4fcf-8955-982ca1700d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:18.616791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311905f-748b-4fcf-8955-982ca1700d72 None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:18.617895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311905f-748b-4fcf-8955-982ca1700d72 None admin] RBAC: Authorizing `identity:get_project(project_id=332a572331234f3d912cfdc615323cb5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:18.619309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311905f-748b-4fcf-8955-982ca1700d72 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:18.620922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 563/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:18 2022] GET /identity/v3/projects/332a572331234f3d912cfdc615323cb5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:18.626988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:18.638859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:18.725134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629a913-ec02-49cd-bd6a-14f8cf43a6e9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:18.758313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23807b8e-fb69-4504-9dce-46aaa146cfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:18.758960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23807b8e-fb69-4504-9dce-46aaa146cfa0 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:18.759239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23807b8e-fb69-4504-9dce-46aaa146cfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:18.759519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23807b8e-fb69-4504-9dce-46aaa146cfa0 None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5/users/e5acf091244746c990d8a505027d1690/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:18.761640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23807b8e-fb69-4504-9dce-46aaa146cfa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=332a572331234f3d912cfdc615323cb5, user_id=e5acf091244746c990d8a505027d1690, role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:18.763070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23807b8e-fb69-4504-9dce-46aaa146cfa0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:18.775329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 560/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:04:18 2022] PUT /identity/v3/projects/332a572331234f3d912cfdc615323cb5/users/e5acf091244746c990d8a505027d1690/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:04:20.651995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a0627-b265-41f1-b0f5-7e3f0803a4fa None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:20.652558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a0627-b265-41f1-b0f5-7e3f0803a4fa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:20.652558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a0627-b265-41f1-b0f5-7e3f0803a4fa None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:20.653886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 564/1124] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:20.659020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49503e-56d3-4fa3-bd6c-b37e219fef93 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:20.659425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49503e-56d3-4fa3-bd6c-b37e219fef93 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:20.660134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49503e-56d3-4fa3-bd6c-b37e219fef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:20.677813 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1a49503e-56d3-4fa3-bd6c-b37e219fef93 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:20.679001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1a49503e-56d3-4fa3-bd6c-b37e219fef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:20.739497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:20.744715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 561/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:21.015077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a0627-b265-41f1-b0f5-7e3f0803a4fa None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.113674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a0627-b265-41f1-b0f5-7e3f0803a4fa None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.147404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.148055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.148334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.148605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] PATH_INFO: `/v3/roles/c78c1448bf3d4eb694c9dc1c6e133999` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.149973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] RBAC: Authorizing `identity:get_role(role_id=c78c1448bf3d4eb694c9dc1c6e133999)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.151322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.152636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 565/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/roles/c78c1448bf3d4eb694c9dc1c6e133999 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:21.158465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49503e-56d3-4fa3-bd6c-b37e219fef93 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.254961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49503e-56d3-4fa3-bd6c-b37e219fef93 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.288011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.288579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.288862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.289139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] PATH_INFO: `/v3/users/e5acf091244746c990d8a505027d1690` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.290255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] RBAC: Authorizing `identity:get_user(user_id=e5acf091244746c990d8a505027d1690)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.291690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.293285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 562/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/users/e5acf091244746c990d8a505027d1690 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:21.299512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.347628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:21.405180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316ed48-83d6-4817-8f55-c62e03a8ad1c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.438322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.438982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.439308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.439584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.504751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.506205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.546609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:21.603784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 566/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:21.609697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.676565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:21.718310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08330c2b-d9c6-4cde-bfa0-77460c1045da None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.751993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de6bdc-ac45-4cde-9018-5caae23b2f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.752741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6bdc-ac45-4cde-9018-5caae23b2f95 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.753020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6bdc-ac45-4cde-9018-5caae23b2f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.753291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de6bdc-ac45-4cde-9018-5caae23b2f95 None admin] PATH_INFO: `/v3/projects/332a572331234f3d912cfdc615323cb5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.754393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6bdc-ac45-4cde-9018-5caae23b2f95 None admin] RBAC: Authorizing `identity:get_project(project_id=332a572331234f3d912cfdc615323cb5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.755838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de6bdc-ac45-4cde-9018-5caae23b2f95 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.757444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 563/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/projects/332a572331234f3d912cfdc615323cb5 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:21.763621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.863047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6939-b77b-430e-8ca8-a719d002771a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.896716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3f33f-5ccd-4fe9-bc4e-aff0539e1b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.897314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f33f-5ccd-4fe9-bc4e-aff0539e1b70 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.897594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f33f-5ccd-4fe9-bc4e-aff0539e1b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.897869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3f33f-5ccd-4fe9-bc4e-aff0539e1b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.898585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3f33f-5ccd-4fe9-bc4e-aff0539e1b70 None admin] RBAC: Adding query filter params (role.id=c78c1448bf3d4eb694c9dc1c6e133999, scope.project.id=332a572331234f3d912cfdc615323cb5, user.id=e5acf091244746c990d8a505027d1690) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:21.898893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3f33f-5ccd-4fe9-bc4e-aff0539e1b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.900340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3f33f-5ccd-4fe9-bc4e-aff0539e1b70 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.905901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 567/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/role_assignments?user.id=e5acf091244746c990d8a505027d1690&scope.project.id=332a572331234f3d912cfdc615323cb5&role.id=c78c1448bf3d4eb694c9dc1c6e133999 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:23.817765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94d588-d4be-40fc-9b9d-17bafa2e422a None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:23.818313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94d588-d4be-40fc-9b9d-17bafa2e422a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:23.818313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94d588-d4be-40fc-9b9d-17bafa2e422a None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:23.819658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 564/1131] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:23.824862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b21ce-e0a6-4850-831b-4f94c674dc7a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:23.825287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b21ce-e0a6-4850-831b-4f94c674dc7a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:23.825542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b21ce-e0a6-4850-831b-4f94c674dc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:23.833520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:23.846267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cd6b21ce-e0a6-4850-831b-4f94c674dc7a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:23.847559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cd6b21ce-e0a6-4850-831b-4f94c674dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:23.913206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 568/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:24.181844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94d588-d4be-40fc-9b9d-17bafa2e422a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:24.282860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94d588-d4be-40fc-9b9d-17bafa2e422a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:24.316364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76941762-0967-4046-8ab4-8907fa451f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:24.316986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76941762-0967-4046-8ab4-8907fa451f88 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:24.317263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76941762-0967-4046-8ab4-8907fa451f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:24.317536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76941762-0967-4046-8ab4-8907fa451f88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:24.318638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76941762-0967-4046-8ab4-8907fa451f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:24.320099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76941762-0967-4046-8ab4-8907fa451f88 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:24.321625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 565/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:24.327773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b21ce-e0a6-4850-831b-4f94c674dc7a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:24.425133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b21ce-e0a6-4850-831b-4f94c674dc7a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:24.457931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657145fd-0d8d-4e87-aa11-ebdbc0bad6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:24.458468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657145fd-0d8d-4e87-aa11-ebdbc0bad6f8 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:24.458748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657145fd-0d8d-4e87-aa11-ebdbc0bad6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:24.459021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657145fd-0d8d-4e87-aa11-ebdbc0bad6f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:24.459669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657145fd-0d8d-4e87-aa11-ebdbc0bad6f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:24.461119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657145fd-0d8d-4e87-aa11-ebdbc0bad6f8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:24.465542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:24.488093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 569/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:04:24 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:04:26.401231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa07a-86a5-496d-9d03-3f96b905cb4b None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:26.401785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa07a-86a5-496d-9d03-3f96b905cb4b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:26.401785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa07a-86a5-496d-9d03-3f96b905cb4b None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:26.403100 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 566/1135] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:26.409224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023f1c-b1c9-442d-89cd-059fb49570af None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:26.409636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023f1c-b1c9-442d-89cd-059fb49570af None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:26.409775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b023f1c-b1c9-442d-89cd-059fb49570af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:26.428243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2b023f1c-b1c9-442d-89cd-059fb49570af None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:26.429429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2b023f1c-b1c9-442d-89cd-059fb49570af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:26.493949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 570/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:26.760952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fa07a-86a5-496d-9d03-3f96b905cb4b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:26.764740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:26.862849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fa07a-86a5-496d-9d03-3f96b905cb4b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:26.896172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39cb45-6eaa-4672-bf56-955225af031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:26.896800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39cb45-6eaa-4672-bf56-955225af031c None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:26.897083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39cb45-6eaa-4672-bf56-955225af031c None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:26.897359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39cb45-6eaa-4672-bf56-955225af031c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:26.898475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39cb45-6eaa-4672-bf56-955225af031c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:26.899948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39cb45-6eaa-4672-bf56-955225af031c None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:26.901502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 567/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:26.907281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b023f1c-b1c9-442d-89cd-059fb49570af None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:27.003415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b023f1c-b1c9-442d-89cd-059fb49570af None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:27.022228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:27.040704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e581a-5a10-4634-9916-a9e1cc04cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:27.041305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e581a-5a10-4634-9916-a9e1cc04cec7 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:27.041581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e581a-5a10-4634-9916-a9e1cc04cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:27.041851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e581a-5a10-4634-9916-a9e1cc04cec7 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:27.042484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e581a-5a10-4634-9916-a9e1cc04cec7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:27.043921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e581a-5a10-4634-9916-a9e1cc04cec7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:27.064256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 571/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:04:26 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:28.995579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5db70-81e7-4ed5-986b-8693ee166fbb None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:28.996165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5db70-81e7-4ed5-986b-8693ee166fbb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:28.996165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5db70-81e7-4ed5-986b-8693ee166fbb None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:28.997552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 568/1139] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:29.003064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849497-12bb-45c9-acd2-2cc2b1541b89 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:29.003465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849497-12bb-45c9-acd2-2cc2b1541b89 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:29.003626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc849497-12bb-45c9-acd2-2cc2b1541b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:29.022582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bc849497-12bb-45c9-acd2-2cc2b1541b89 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:29.023773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bc849497-12bb-45c9-acd2-2cc2b1541b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:29.088637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 572/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:29.361011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5db70-81e7-4ed5-986b-8693ee166fbb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:29.430464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:29.461062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5db70-81e7-4ed5-986b-8693ee166fbb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:29.493941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:29.494563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:29.494841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:29.495113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:29.505563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:29.510254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:29.511381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:29.512678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 569/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:29.517569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849497-12bb-45c9-acd2-2cc2b1541b89 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:29.616398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc849497-12bb-45c9-acd2-2cc2b1541b89 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:29.617826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:29.651718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:29.652351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:29.652630 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:29.652901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:29.653562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:29.653865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:29.655214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:29.663291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 573/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:29.669113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:29.766653 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b27c3-586c-491a-8eec-5739e7dd56f2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:29.795357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:29.801465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:29.802090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:29.802367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:29.802639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] PATH_INFO: `/v3/users/c50b6393552e4664ae1f3da4cfb95031` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:29.816243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] RBAC: Authorizing `identity:get_user(user_id=c50b6393552e4664ae1f3da4cfb95031)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:29.817674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:29.819254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 570/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:29 2022] GET /identity/v3/users/c50b6393552e4664ae1f3da4cfb95031 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:29.825223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:29.923714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4e7ef-e8ce-4d47-bcec-07133b95598c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:29.955475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:29.956214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:29.956493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:29.956764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:29.987038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:30.022623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:30.024072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:30.119231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 574/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:30.125156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:30.221638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5bece-d7c4-4916-9544-bd300e68ad99 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:30.257050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091e175-7bbd-4cd0-9c09-7e94d960ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:30.257685 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091e175-7bbd-4cd0-9c09-7e94d960ea8a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:30.257970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091e175-7bbd-4cd0-9c09-7e94d960ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:30.258248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091e175-7bbd-4cd0-9c09-7e94d960ea8a None admin] PATH_INFO: `/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:30.259363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091e175-7bbd-4cd0-9c09-7e94d960ea8a None admin] RBAC: Authorizing `identity:get_project(project_id=53ad6cba8e4d4cba9ddf63bdfbb48f03)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:30.260827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091e175-7bbd-4cd0-9c09-7e94d960ea8a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:30.262536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 571/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:30 2022] GET /identity/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:30.269687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:30.329662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:30.366991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e4fd-a97d-40c0-a30d-a22c8b0f21bb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:30.400252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5b2bf-e2ef-4ead-ad66-5dbc423dccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:30.400843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b2bf-e2ef-4ead-ad66-5dbc423dccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:30.401119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b2bf-e2ef-4ead-ad66-5dbc423dccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:30.401387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5b2bf-e2ef-4ead-ad66-5dbc423dccf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:30.402103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b2bf-e2ef-4ead-ad66-5dbc423dccf3 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=53ad6cba8e4d4cba9ddf63bdfbb48f03, user.id=c50b6393552e4664ae1f3da4cfb95031) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:30.402406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b2bf-e2ef-4ead-ad66-5dbc423dccf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:30.403824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5b2bf-e2ef-4ead-ad66-5dbc423dccf3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:30.409981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 575/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:30 2022] GET /identity/v3/role_assignments?user.id=c50b6393552e4664ae1f3da4cfb95031&scope.project.id=53ad6cba8e4d4cba9ddf63bdfbb48f03&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:32.268843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e757c1-f23e-4f2d-a800-ee3dac03cc53 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:32.269368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e757c1-f23e-4f2d-a800-ee3dac03cc53 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:32.269368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e757c1-f23e-4f2d-a800-ee3dac03cc53 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:32.270701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 572/1147] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:32.275911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4cf3c-78c2-4664-b362-1048e6620318 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:32.276306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4cf3c-78c2-4664-b362-1048e6620318 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:32.276465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4cf3c-78c2-4664-b362-1048e6620318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:32.294391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b7d4cf3c-78c2-4664-b362-1048e6620318 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:32.295587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b7d4cf3c-78c2-4664-b362-1048e6620318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:32.361674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 576/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:32.627498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e757c1-f23e-4f2d-a800-ee3dac03cc53 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:32.685218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:32.727558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e757c1-f23e-4f2d-a800-ee3dac03cc53 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:32.761383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:32.761998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:32.762277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:32.762546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:32.772691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:32.777358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:32.778530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:32.779548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 573/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:32.784724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4cf3c-78c2-4664-b362-1048e6620318 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:32.841787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:32.883332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4cf3c-78c2-4664-b362-1048e6620318 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:32.916684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:32.917286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:32.917571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:32.917846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:32.918514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:32.918821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:32.920400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:32.929001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 577/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:32.934776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:33.034138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0126d1-fa65-49aa-8cef-1d5f7398255a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:33.050985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:33.067646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:33.068301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:33.068583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:33.068857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] PATH_INFO: `/v3/users/c50b6393552e4664ae1f3da4cfb95031` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:33.069966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] RBAC: Authorizing `identity:get_user(user_id=c50b6393552e4664ae1f3da4cfb95031)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:33.071390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:33.072994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 574/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:32 2022] GET /identity/v3/users/c50b6393552e4664ae1f3da4cfb95031 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:33.078847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:33.181751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056a2e-6bdc-4e77-810d-25e6a7438c8b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:33.200550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:33.214656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b115a1-c5d0-4415-af44-b86bb2a465e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:33.215279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b115a1-c5d0-4415-af44-b86bb2a465e4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:33.215555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b115a1-c5d0-4415-af44-b86bb2a465e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:33.215850 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b115a1-c5d0-4415-af44-b86bb2a465e4 None admin] PATH_INFO: `/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:33.216954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b115a1-c5d0-4415-af44-b86bb2a465e4 None admin] RBAC: Authorizing `identity:get_project(project_id=53ad6cba8e4d4cba9ddf63bdfbb48f03)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:33.218362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b115a1-c5d0-4415-af44-b86bb2a465e4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:33.220850 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 578/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:33 2022] GET /identity/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:33.226786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:33.324425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5d4bb-127e-480b-b094-6d4a250ff324 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:33.361255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f10aa2-61f5-4453-8f2b-3c82724d321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:33.361938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10aa2-61f5-4453-8f2b-3c82724d321b None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:33.362196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10aa2-61f5-4453-8f2b-3c82724d321b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:33.362472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f10aa2-61f5-4453-8f2b-3c82724d321b None admin] PATH_INFO: `/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03/users/c50b6393552e4664ae1f3da4cfb95031/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:33.364407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f10aa2-61f5-4453-8f2b-3c82724d321b None admin] RBAC: Authorizing `identity:create_grant(project_id=53ad6cba8e4d4cba9ddf63bdfbb48f03, user_id=c50b6393552e4664ae1f3da4cfb95031, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:33.365837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f10aa2-61f5-4453-8f2b-3c82724d321b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:33.385013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 575/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:04:33 2022] PUT /identity/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03/users/c50b6393552e4664ae1f3da4cfb95031/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:04:35.258691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407186bb-c54f-4303-8a0f-e9618496a9f1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:35.259221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407186bb-c54f-4303-8a0f-e9618496a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:35.259221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407186bb-c54f-4303-8a0f-e9618496a9f1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:35.260615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 579/1154] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:35.265768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fedaf-ae40-45fe-8253-9eda136b54d9 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:35.266185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fedaf-ae40-45fe-8253-9eda136b54d9 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:35.266558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fedaf-ae40-45fe-8253-9eda136b54d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:35.284658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e58fedaf-ae40-45fe-8253-9eda136b54d9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:35.285841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e58fedaf-ae40-45fe-8253-9eda136b54d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:35.326580 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:35.353042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 576/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:35.631714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407186bb-c54f-4303-8a0f-e9618496a9f1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:35.731586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407186bb-c54f-4303-8a0f-e9618496a9f1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:35.764110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:35.764737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:35.765015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:35.765288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:35.776995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:35.781743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:35.783655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:35.784569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 580/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:35.789430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fedaf-ae40-45fe-8253-9eda136b54d9 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:35.886826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fedaf-ae40-45fe-8253-9eda136b54d9 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:35.920186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:35.920790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:35.921069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:35.921341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:35.922002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:35.922335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:35.923729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:35.931650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 577/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:35.937448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:35.986478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:36.036700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866eef-3f01-46b2-b6b5-09efd6175228 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:36.069478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:36.070100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:36.070382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:36.070658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] PATH_INFO: `/v3/users/c50b6393552e4664ae1f3da4cfb95031` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:36.071765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] RBAC: Authorizing `identity:get_user(user_id=c50b6393552e4664ae1f3da4cfb95031)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:36.073212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:36.074762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 581/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:35 2022] GET /identity/v3/users/c50b6393552e4664ae1f3da4cfb95031 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:36.081874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:36.121097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:36.179640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a2ebb-58d9-44fa-8fd4-6f6a87477a94 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:36.212969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:36.213570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:36.213850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:36.214125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:36.278691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:36.280178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:36.317052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:36.378110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 578/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:36.384186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:36.480271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71961b-3bc2-4b2a-a821-061bc7ed439e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:36.498941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:36.522595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600b25-7712-47f1-b4fb-98ceb63b1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:36.523224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600b25-7712-47f1-b4fb-98ceb63b1ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:36.523504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600b25-7712-47f1-b4fb-98ceb63b1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:36.523780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600b25-7712-47f1-b4fb-98ceb63b1ec8 None admin] PATH_INFO: `/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:36.524908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600b25-7712-47f1-b4fb-98ceb63b1ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=53ad6cba8e4d4cba9ddf63bdfbb48f03)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:36.526332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600b25-7712-47f1-b4fb-98ceb63b1ec8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:36.528019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 582/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:36 2022] GET /identity/v3/projects/53ad6cba8e4d4cba9ddf63bdfbb48f03 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:36.534210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:36.631604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581571-b101-4dc7-950b-33d3625c2739 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:36.664681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf1be-f536-4841-a28c-41e90fc06182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:36.665275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf1be-f536-4841-a28c-41e90fc06182 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:36.665556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf1be-f536-4841-a28c-41e90fc06182 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:36.665826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf1be-f536-4841-a28c-41e90fc06182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:36.666543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cf1be-f536-4841-a28c-41e90fc06182 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=53ad6cba8e4d4cba9ddf63bdfbb48f03, user.id=c50b6393552e4664ae1f3da4cfb95031) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:36.666852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cf1be-f536-4841-a28c-41e90fc06182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:36.668304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cf1be-f536-4841-a28c-41e90fc06182 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:36.674573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 579/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:36 2022] GET /identity/v3/role_assignments?user.id=c50b6393552e4664ae1f3da4cfb95031&scope.project.id=53ad6cba8e4d4cba9ddf63bdfbb48f03&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:38.583362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f933f6-d69a-4e5a-b0ac-b5d1868cc030 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:38.583937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f933f6-d69a-4e5a-b0ac-b5d1868cc030 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:38.583937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f933f6-d69a-4e5a-b0ac-b5d1868cc030 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:38.585251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 583/1162] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:38.590459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a3e6-2e03-48b7-bc43-58a11064e8d1 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:38.590853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a3e6-2e03-48b7-bc43-58a11064e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:38.591018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a3e6-2e03-48b7-bc43-58a11064e8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:38.603361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:38.616666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6369a3e6-2e03-48b7-bc43-58a11064e8d1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:38.617870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6369a3e6-2e03-48b7-bc43-58a11064e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:38.682666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 580/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:38.956591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f933f6-d69a-4e5a-b0ac-b5d1868cc030 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:39.055386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f933f6-d69a-4e5a-b0ac-b5d1868cc030 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:39.088916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:39.089470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:39.089753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:39.090030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:39.144432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:39.160178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:39.161633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:39.259019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 584/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:39.264926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a3e6-2e03-48b7-bc43-58a11064e8d1 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:39.361480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a3e6-2e03-48b7-bc43-58a11064e8d1 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:39.389822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:39.395314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c146a9-438e-480f-b9f8-2d80dff91eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:39.395982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c146a9-438e-480f-b9f8-2d80dff91eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:39.396269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c146a9-438e-480f-b9f8-2d80dff91eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:39.396545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c146a9-438e-480f-b9f8-2d80dff91eb4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:39.403326 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c146a9-438e-480f-b9f8-2d80dff91eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:39.404800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c146a9-438e-480f-b9f8-2d80dff91eb4 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-45c146a9-438e-480f-b9f8-2d80dff91eb4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:39.416102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:39.417204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:39.418091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 581/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:04:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:39.423677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:39.507055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:39.522590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145e4a-86b0-4782-a887-4f890d81954a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:39.555158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608e051-5e02-4a8d-bfa0-e6d83c12b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:39.555749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e051-5e02-4a8d-bfa0-e6d83c12b36b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:39.556067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e051-5e02-4a8d-bfa0-e6d83c12b36b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:39.556337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608e051-5e02-4a8d-bfa0-e6d83c12b36b None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:39.556969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608e051-5e02-4a8d-bfa0-e6d83c12b36b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:39.557272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608e051-5e02-4a8d-bfa0-e6d83c12b36b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:39.558618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608e051-5e02-4a8d-bfa0-e6d83c12b36b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:39.566249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 585/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Aug 17 16:04:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:41.473428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7dcd-c48e-470a-93a3-fa15afa34ea3 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:41.473984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7dcd-c48e-470a-93a3-fa15afa34ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:41.473984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7dcd-c48e-470a-93a3-fa15afa34ea3 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:41.475323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 582/1167] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:41.480626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb7948-1e1c-45ff-81ba-d27f51ddc433 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:41.480996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb7948-1e1c-45ff-81ba-d27f51ddc433 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:41.481180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb7948-1e1c-45ff-81ba-d27f51ddc433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:41.499323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7dfb7948-1e1c-45ff-81ba-d27f51ddc433 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:41.501332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7dfb7948-1e1c-45ff-81ba-d27f51ddc433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:41.566353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 586/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:41.839102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7dcd-c48e-470a-93a3-fa15afa34ea3 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:41.937606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7dcd-c48e-470a-93a3-fa15afa34ea3 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:41.970524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46972b-009e-45f7-adca-5556f437a5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:41.971116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46972b-009e-45f7-adca-5556f437a5dc None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:41.971395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46972b-009e-45f7-adca-5556f437a5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:41.971668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46972b-009e-45f7-adca-5556f437a5dc None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:41.972363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46972b-009e-45f7-adca-5556f437a5dc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:41.973720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46972b-009e-45f7-adca-5556f437a5dc None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:41.989349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 583/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Wed Aug 17 16:04:41 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:43.903352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b151b-a0eb-4531-86ee-c3544057aee6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:43.903889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b151b-a0eb-4531-86ee-c3544057aee6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:43.904010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b151b-a0eb-4531-86ee-c3544057aee6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:43.905262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 587/1170] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:43.910714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5a525-d4ef-4763-9bbc-be31cd5b8547 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:43.911119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5a525-d4ef-4763-9bbc-be31cd5b8547 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:43.911256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5a525-d4ef-4763-9bbc-be31cd5b8547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:43.929744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a0d5a525-d4ef-4763-9bbc-be31cd5b8547 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:43.930917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a0d5a525-d4ef-4763-9bbc-be31cd5b8547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:43.976622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:43.998455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 584/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:44.274351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b151b-a0eb-4531-86ee-c3544057aee6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:44.352333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:44.375176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b151b-a0eb-4531-86ee-c3544057aee6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:44.408261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f29449-3259-4220-ae68-f7cfa4c90d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:44.408883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f29449-3259-4220-ae68-f7cfa4c90d8b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:44.409166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f29449-3259-4220-ae68-f7cfa4c90d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:44.409442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f29449-3259-4220-ae68-f7cfa4c90d8b None admin] PATH_INFO: `/v3/domains/88c40c6058834e2cbb985b09ebec313c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:44.419465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f29449-3259-4220-ae68-f7cfa4c90d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=88c40c6058834e2cbb985b09ebec313c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:44.420920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f29449-3259-4220-ae68-f7cfa4c90d8b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:44.423070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 588/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Aug 17 16:04:44 2022] GET /identity/v3/domains/88c40c6058834e2cbb985b09ebec313c => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:44.428922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5a525-d4ef-4763-9bbc-be31cd5b8547 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:44.526242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5a525-d4ef-4763-9bbc-be31cd5b8547 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:44.558961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1873-7e8b-4897-b5de-2bbbc85d0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:44.559557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1873-7e8b-4897-b5de-2bbbc85d0cef None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:44.559860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1873-7e8b-4897-b5de-2bbbc85d0cef None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:44.560133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1873-7e8b-4897-b5de-2bbbc85d0cef None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:44.560773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df1873-7e8b-4897-b5de-2bbbc85d0cef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:44.562203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df1873-7e8b-4897-b5de-2bbbc85d0cef None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:44.587906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 585/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:04:44 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:46.520982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2981df-715a-4736-908b-a699d6db5b71 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:46.521573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2981df-715a-4736-908b-a699d6db5b71 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:46.521573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2981df-715a-4736-908b-a699d6db5b71 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:46.522888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 589/1174] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:46.528124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863394b-1441-43a9-852f-49c009caaf1a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:46.528565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863394b-1441-43a9-852f-49c009caaf1a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:46.528663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863394b-1441-43a9-852f-49c009caaf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:46.546845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5863394b-1441-43a9-852f-49c009caaf1a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:46.548686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5863394b-1441-43a9-852f-49c009caaf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:46.574063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:46.615007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 586/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:46.881123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2981df-715a-4736-908b-a699d6db5b71 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:46.985069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2981df-715a-4736-908b-a699d6db5b71 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:47.018940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc900e20-3e08-4526-ac86-a9e37dcb2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:47.019567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900e20-3e08-4526-ac86-a9e37dcb2d92 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:47.019881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900e20-3e08-4526-ac86-a9e37dcb2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:47.020161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900e20-3e08-4526-ac86-a9e37dcb2d92 None admin] PATH_INFO: `/v3/domains/88c40c6058834e2cbb985b09ebec313c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:47.021271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc900e20-3e08-4526-ac86-a9e37dcb2d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=88c40c6058834e2cbb985b09ebec313c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:47.022688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc900e20-3e08-4526-ac86-a9e37dcb2d92 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:47.024279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 590/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Aug 17 16:04:46 2022] GET /identity/v3/domains/88c40c6058834e2cbb985b09ebec313c => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:47.030152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863394b-1441-43a9-852f-49c009caaf1a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:47.125719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863394b-1441-43a9-852f-49c009caaf1a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:47.159851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ec0d9-5f62-48e8-83ee-e886353097eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:47.160455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ec0d9-5f62-48e8-83ee-e886353097eb None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:47.160736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ec0d9-5f62-48e8-83ee-e886353097eb None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:47.161012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ec0d9-5f62-48e8-83ee-e886353097eb None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:47.161645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ec0d9-5f62-48e8-83ee-e886353097eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:47.163085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ec0d9-5f62-48e8-83ee-e886353097eb None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:47.189439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 587/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:04:47 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:49.108558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1b033-7da0-460e-b5fb-71aef160e452 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:49.109095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1b033-7da0-460e-b5fb-71aef160e452 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:49.109095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1b033-7da0-460e-b5fb-71aef160e452 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:49.110472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 591/1178] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:49.115506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915542-b8ae-4adb-bc58-ccede7267e88 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:49.115953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915542-b8ae-4adb-bc58-ccede7267e88 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:49.116093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915542-b8ae-4adb-bc58-ccede7267e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:49.133772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a0915542-b8ae-4adb-bc58-ccede7267e88 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:49.134957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a0915542-b8ae-4adb-bc58-ccede7267e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:49.149138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:49.200550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 588/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:49.475681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1b033-7da0-460e-b5fb-71aef160e452 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:49.485767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:49.577822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1b033-7da0-460e-b5fb-71aef160e452 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:49.611240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:49.611887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:49.612174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:49.612453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:49.622745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:49.627669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:49.628823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:49.629848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 592/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:49.634839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915542-b8ae-4adb-bc58-ccede7267e88 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:49.733574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915542-b8ae-4adb-bc58-ccede7267e88 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:49.765848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:49.766992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:49.767458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:49.767994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:49.769149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:49.769699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:49.772311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:49.783185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 589/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:49.788896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:49.855064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:49.889459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8959281-a12b-4bfe-83b6-4062ff149001 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:49.922633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:49.923268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:49.923545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:49.923856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] PATH_INFO: `/v3/users/04455850c27e41c8ba9181667f4f56de` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:49.936468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] RBAC: Authorizing `identity:get_user(user_id=04455850c27e41c8ba9181667f4f56de)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:49.937893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:49.939517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 593/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:49 2022] GET /identity/v3/users/04455850c27e41c8ba9181667f4f56de => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:49.945751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:49.961317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:50.046047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c780-7678-402d-95cc-76ee6fd02a45 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:50.077803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:50.078403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:50.078686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:50.079493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:50.145547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:50.146991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:50.159950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:50.243593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 590/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:50.252411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:50.348532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38297d0d-d2cb-479a-b2f0-030d1c0c9794 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:50.371163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:50.382438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2e015-a38c-479f-b8d4-b809a99c3373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:50.383074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e015-a38c-479f-b8d4-b809a99c3373 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:50.383335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e015-a38c-479f-b8d4-b809a99c3373 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:50.383604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e015-a38c-479f-b8d4-b809a99c3373 None admin] PATH_INFO: `/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:50.384726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2e015-a38c-479f-b8d4-b809a99c3373 None admin] RBAC: Authorizing `identity:get_project(project_id=67049d1a0e584b7a9fbee51dd5bf33f0)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:50.386132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2e015-a38c-479f-b8d4-b809a99c3373 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:50.387711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 594/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:50 2022] GET /identity/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:50.394372 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:50.491635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a14f-f32e-441d-9e2e-56a6985d08a9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:50.505129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:50.526423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1baaad-b76f-411f-b9c2-549fb1782e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:50.527020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1baaad-b76f-411f-b9c2-549fb1782e61 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:50.527299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1baaad-b76f-411f-b9c2-549fb1782e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:50.527569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1baaad-b76f-411f-b9c2-549fb1782e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:50.528314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1baaad-b76f-411f-b9c2-549fb1782e61 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=67049d1a0e584b7a9fbee51dd5bf33f0, user.id=04455850c27e41c8ba9181667f4f56de) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:50.528622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1baaad-b76f-411f-b9c2-549fb1782e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:50.530037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1baaad-b76f-411f-b9c2-549fb1782e61 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:50.535289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 591/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:50 2022] GET /identity/v3/role_assignments?user.id=04455850c27e41c8ba9181667f4f56de&scope.project.id=67049d1a0e584b7a9fbee51dd5bf33f0&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:52.417594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55815c-db5c-4458-9f53-c0c29f438523 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.418147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55815c-db5c-4458-9f53-c0c29f438523 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.418147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55815c-db5c-4458-9f53-c0c29f438523 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.419476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 595/1186] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:52.424894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cf2c-a949-4d27-8218-168073f35561 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.425265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cf2c-a949-4d27-8218-168073f35561 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.425456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cf2c-a949-4d27-8218-168073f35561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.443791 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-be20cf2c-a949-4d27-8218-168073f35561 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:52.445018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-be20cf2c-a949-4d27-8218-168073f35561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:52.512997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 592/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:52.787213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55815c-db5c-4458-9f53-c0c29f438523 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:52.887762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55815c-db5c-4458-9f53-c0c29f438523 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:52.920250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:52.920868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:52.921145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:52.921415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:52.931718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:52.936682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:52.937699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:04:52.939323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 596/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:52.944820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20cf2c-a949-4d27-8218-168073f35561 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:53.041347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20cf2c-a949-4d27-8218-168073f35561 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:53.049276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:53.075746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:53.076379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.076663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.076940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.077606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:53.077913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:53.079314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:53.087106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 593/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:53.092814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:53.146049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:53.192984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c02f95-f966-45fc-8cb0-20cfb7f3f875 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:53.226436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:53.227054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.227329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.227886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] PATH_INFO: `/v3/users/04455850c27e41c8ba9181667f4f56de` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.228987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] RBAC: Authorizing `identity:get_user(user_id=04455850c27e41c8ba9181667f4f56de)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:53.230400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:53.231958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 597/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:53 2022] GET /identity/v3/users/04455850c27e41c8ba9181667f4f56de => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:53.238655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:53.335512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e489b8-3cc1-4061-8b0d-578c66d681cf None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:53.368615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4ff88-9cfd-4055-a773-c7221c01f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:53.369221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ff88-9cfd-4055-a773-c7221c01f846 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.369499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ff88-9cfd-4055-a773-c7221c01f846 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.369776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4ff88-9cfd-4055-a773-c7221c01f846 None admin] PATH_INFO: `/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.370868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4ff88-9cfd-4055-a773-c7221c01f846 None admin] RBAC: Authorizing `identity:get_project(project_id=67049d1a0e584b7a9fbee51dd5bf33f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:53.372324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4ff88-9cfd-4055-a773-c7221c01f846 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:53.373902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 594/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:53 2022] GET /identity/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:53.379852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:53.476973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893927e-9b1b-49ff-b0d8-ff6c09cef62e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:53.496421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:53.510193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc416cb-2cda-483a-8b6a-7f484d42256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:53.510865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc416cb-2cda-483a-8b6a-7f484d42256e None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:53.511144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc416cb-2cda-483a-8b6a-7f484d42256e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:53.511444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc416cb-2cda-483a-8b6a-7f484d42256e None admin] PATH_INFO: `/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0/users/04455850c27e41c8ba9181667f4f56de/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:53.513330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc416cb-2cda-483a-8b6a-7f484d42256e None admin] RBAC: Authorizing `identity:create_grant(project_id=67049d1a0e584b7a9fbee51dd5bf33f0, user_id=04455850c27e41c8ba9181667f4f56de, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:53.514742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc416cb-2cda-483a-8b6a-7f484d42256e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:53.527715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 598/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:04:53 2022] PUT /identity/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0/users/04455850c27e41c8ba9181667f4f56de/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:04:55.404377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd85f0-f984-4bb8-9d6a-e0e801787e86 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.404936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd85f0-f984-4bb8-9d6a-e0e801787e86 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.404936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd85f0-f984-4bb8-9d6a-e0e801787e86 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.406257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 595/1193] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:55.411409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ae91d-1f4e-4de4-bbab-cb4f12c60b43 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.411838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ae91d-1f4e-4de4-bbab-cb4f12c60b43 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.412021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ae91d-1f4e-4de4-bbab-cb4f12c60b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.430194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9f5ae91d-1f4e-4de4-bbab-cb4f12c60b43 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:55.431364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9f5ae91d-1f4e-4de4-bbab-cb4f12c60b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:55.500042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 599/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:55.769704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd85f0-f984-4bb8-9d6a-e0e801787e86 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:55.805268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:55.871338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd85f0-f984-4bb8-9d6a-e0e801787e86 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:55.903317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:55.903967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:55.904248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:55.904518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:55.914677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:04:55.919331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:55.920463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:04:55.921510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 596/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:55.927131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ae91d-1f4e-4de4-bbab-cb4f12c60b43 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.023183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ae91d-1f4e-4de4-bbab-cb4f12c60b43 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.033476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:56.057364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.057961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.058241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.058516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.059174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:56.059478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.060872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.069292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 600/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:56.075184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.168354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:56.174943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a911c29-6571-45b5-b036-fce260285714 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.207355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.207997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.208280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.208552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] PATH_INFO: `/v3/users/04455850c27e41c8ba9181667f4f56de` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.209646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] RBAC: Authorizing `identity:get_user(user_id=04455850c27e41c8ba9181667f4f56de)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.211131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.212708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 597/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Aug 17 16:04:56 2022] GET /identity/v3/users/04455850c27e41c8ba9181667f4f56de => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:56.218553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.316559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3de8b-cec7-4b9d-8cde-bcb04d0e939e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.349512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.350104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.350381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.350651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.390273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:56.416771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.418192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.514733 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 601/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:04:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:04:56.521205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.617682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b092b6c-3cdf-46f2-9d47-73c0e4984bba None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.649804 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1f825-3464-4eb3-9b46-12b68e491848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.650425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1f825-3464-4eb3-9b46-12b68e491848 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.650707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1f825-3464-4eb3-9b46-12b68e491848 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.650981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1f825-3464-4eb3-9b46-12b68e491848 None admin] PATH_INFO: `/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.652110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1f825-3464-4eb3-9b46-12b68e491848 None admin] RBAC: Authorizing `identity:get_project(project_id=67049d1a0e584b7a9fbee51dd5bf33f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.653536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1f825-3464-4eb3-9b46-12b68e491848 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.655137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 598/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Aug 17 16:04:56 2022] GET /identity/v3/projects/67049d1a0e584b7a9fbee51dd5bf33f0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:56.662088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:56.729570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:56.758228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436037c-9f48-4791-8c4d-360c99bdea39 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:56.791637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e39d7-c30e-4d44-af90-df7bc90acb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:56.792251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e39d7-c30e-4d44-af90-df7bc90acb32 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:56.792528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e39d7-c30e-4d44-af90-df7bc90acb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:56.792796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e39d7-c30e-4d44-af90-df7bc90acb32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:56.793503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e39d7-c30e-4d44-af90-df7bc90acb32 None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=67049d1a0e584b7a9fbee51dd5bf33f0, user.id=04455850c27e41c8ba9181667f4f56de) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:56.793806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e39d7-c30e-4d44-af90-df7bc90acb32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:56.795202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e39d7-c30e-4d44-af90-df7bc90acb32 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:56.801082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 602/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:04:56 2022] GET /identity/v3/role_assignments?user.id=04455850c27e41c8ba9181667f4f56de&scope.project.id=67049d1a0e584b7a9fbee51dd5bf33f0&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:06.645808 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=84 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:06.798611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=32 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.039068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54df06-6701-4773-89a1-63adf2791123 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.039673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54df06-6701-4773-89a1-63adf2791123 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.039673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54df06-6701-4773-89a1-63adf2791123 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.041328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 599/1201] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:52.048812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19680a5-e386-43f3-811d-56cd37101f8e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.049355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19680a5-e386-43f3-811d-56cd37101f8e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.049355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19680a5-e386-43f3-811d-56cd37101f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.072845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e19680a5-e386-43f3-811d-56cd37101f8e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:52.074115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e19680a5-e386-43f3-811d-56cd37101f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:52.159847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 603/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:52.432008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54df06-6701-4773-89a1-63adf2791123 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.564046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54df06-6701-4773-89a1-63adf2791123 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.611380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.612159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.612449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.612707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.629497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.629497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:52.646483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:52.647609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:52.648699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:52.648699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:52.648699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:05:52.653275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 600/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:52.653779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19680a5-e386-43f3-811d-56cd37101f8e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.789670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19680a5-e386-43f3-811d-56cd37101f8e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.828237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.831445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098792a7-5824-4ed1-bb6c-a6276f650f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.835002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098792a7-5824-4ed1-bb6c-a6276f650f4c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.835002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098792a7-5824-4ed1-bb6c-a6276f650f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.835002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098792a7-5824-4ed1-bb6c-a6276f650f4c None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.835002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098792a7-5824-4ed1-bb6c-a6276f650f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:52.835407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098792a7-5824-4ed1-bb6c-a6276f650f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.838748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098792a7-5824-4ed1-bb6c-a6276f650f4c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.860235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 604/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:52.862220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.929108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.989971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1f2da-8e26-422f-b0c4-e1c7a0d69f87 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:53.033409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717a9c5-4303-48d5-a660-e669642e7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:53.034549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717a9c5-4303-48d5-a660-e669642e7167 None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:53.034869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717a9c5-4303-48d5-a660-e669642e7167 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:53.035193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717a9c5-4303-48d5-a660-e669642e7167 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:53.036022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717a9c5-4303-48d5-a660-e669642e7167 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:53.037574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717a9c5-4303-48d5-a660-e669642e7167 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:53.062720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 601/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:52 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:55.080333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e3f0-ad0a-4b5b-bf25-8989f2df2d8e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.080914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e3f0-ad0a-4b5b-bf25-8989f2df2d8e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.080914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915e3f0-ad0a-4b5b-bf25-8989f2df2d8e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.082293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 605/1206] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:55.088449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa476a9-3e34-4462-8c9d-4f2bea11e7d4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.088975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa476a9-3e34-4462-8c9d-4f2bea11e7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.088975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa476a9-3e34-4462-8c9d-4f2bea11e7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.110061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-eaa476a9-3e34-4462-8c9d-4f2bea11e7d4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:55.111364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-eaa476a9-3e34-4462-8c9d-4f2bea11e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:55.188495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 602/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:55.464771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915e3f0-ad0a-4b5b-bf25-8989f2df2d8e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.580623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915e3f0-ad0a-4b5b-bf25-8989f2df2d8e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:55.627420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:55.628090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.628370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.628633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.640593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:55.645567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:55.646755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:05:55.647611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 606/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:55.652825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa476a9-3e34-4462-8c9d-4f2bea11e7d4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.706357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:55.785723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa476a9-3e34-4462-8c9d-4f2bea11e7d4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:55.829994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:55.830629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:55.831064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:55.831369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:55.832167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:55.832478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:55.833867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:55.843551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 603/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:55.849443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:55.903639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:55.965450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a6daa-513f-4592-b045-abd695bd78b2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.004898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.005545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.005913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.006142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.023781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.025714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:56.050335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:56.051545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:56.052597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:56.052597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:56.052597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:05:56.052597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 607/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:56.057936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.177643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.183191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb1a1-4f17-43f1-85f2-8e4eeaf4c3a9 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.231158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.232109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.232495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.232772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.233625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:56.234013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.237162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.251875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 604/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:56.256870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.387945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6793029-ae9d-4bc9-b8ed-db1b2fd5e0ca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.390942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.433101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.433814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.434099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.434387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.443653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.445394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:05:56.458808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:56.464562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:05:56.465792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 608/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:56.466609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.587400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669e766-644f-49eb-aef4-29b1edf82c55 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.633928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.634827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.635275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.635724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.636477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:56.636834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.638366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:56.659142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 605/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 17 16:05:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:56.664940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:56.791373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73927873-0d3f-4deb-81dd-c8af17e4c12a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:56.840931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:56.842221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.842549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.842892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.880514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.929258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:56.930678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.062332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 609/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:05:57.067525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.090127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.203842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e80dac-103b-4325-9b48-6a901265eeac None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.247332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.248821 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.249126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.249316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.261106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.262707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:57.282051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:57.287963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:57.289183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:57.289183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:57.289183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:05:57.289183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 606/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:57.289502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.363942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.410792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c87fb5-e736-46cf-8aef-53682b040d46 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.449368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.450071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.450420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.450830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.451739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:57.452086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.453451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.467460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 610/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:57.472696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.551523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.586377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7efb-89ed-4465-8411-3d3c8531d923 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.625185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.625824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.626106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.626380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.633226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.634670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:05:57.645946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:57.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:05:57.647850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 607/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:57.652998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.773696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f01759-bc39-4ebb-b5ec-2aaa86e02267 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.799605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.814184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f38830-ce29-496c-a2f1-169497df1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.814841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38830-ce29-496c-a2f1-169497df1c0d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.815127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38830-ce29-496c-a2f1-169497df1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.815401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f38830-ce29-496c-a2f1-169497df1c0d None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.816238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38830-ce29-496c-a2f1-169497df1c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:57.816546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38830-ce29-496c-a2f1-169497df1c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.817963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f38830-ce29-496c-a2f1-169497df1c0d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.837903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 611/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:57.839202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.955534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552e225-b1ee-49b3-aa9d-b02053d92a5b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.991454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.999620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32c918-e398-4729-805b-161458876437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:58.000273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c918-e398-4729-805b-161458876437 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:58.000555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c918-e398-4729-805b-161458876437 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:58.000828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32c918-e398-4729-805b-161458876437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:58.001574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32c918-e398-4729-805b-161458876437 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=1b4c5c17981649e8a4cffdb84cda0374) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:58.001885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32c918-e398-4729-805b-161458876437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:58.003368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32c918-e398-4729-805b-161458876437 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:58.010577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 608/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/role_assignments?user.id=1b4c5c17981649e8a4cffdb84cda0374&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:59.922690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ec71-196d-4e7d-b203-5c347b0e9a50 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.923241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ec71-196d-4e7d-b203-5c347b0e9a50 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.923350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ec71-196d-4e7d-b203-5c347b0e9a50 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.924806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 612/1220] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:59.930218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608c1f9-a40b-4283-b55a-cf89a2861fcd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.930670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608c1f9-a40b-4283-b55a-cf89a2861fcd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.930783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608c1f9-a40b-4283-b55a-cf89a2861fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.949658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6608c1f9-a40b-4283-b55a-cf89a2861fcd None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:59.951402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6608c1f9-a40b-4283-b55a-cf89a2861fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:00.029211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 609/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:00.343980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ec71-196d-4e7d-b203-5c347b0e9a50 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.460808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ec71-196d-4e7d-b203-5c347b0e9a50 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.499742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.500412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.500698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.500976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.511011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:00.516017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:00.516950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:00.517786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 613/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:00.523081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608c1f9-a40b-4283-b55a-cf89a2861fcd None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.628109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608c1f9-a40b-4283-b55a-cf89a2861fcd None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.653001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.666468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.667268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.667554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.667894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.668757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:00.669102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.675494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.685578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 610/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:00.691475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.742674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.804240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56c974-65ac-4bff-ae28-445a6c569276 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.844745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.845386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.845665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.845938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.857781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.859425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:00.873690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:00.874727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:00.875673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:00.875673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:00.875673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:00.875673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 614/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:00.880868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.990869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892a68c-162d-48b7-85ee-83bdea4fc7f5 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.040076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.040888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.041322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.041663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.042570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:01.042908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.045164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.062384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 611/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:01.068199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.166631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.173924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27eaf7-5587-4eb2-a5e0-239df6e27620 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.208360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.208997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.209279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.209556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.217676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.219120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:01.230747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:01.231907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:01.233797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 615/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:01.238657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.295974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.355262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc8305-9cc1-4ed6-8feb-4bff83a67c4f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.392979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.393623 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.393980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.394233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.395058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:01.395396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.397000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.415536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 612/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:01.421734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.531430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fda8a-b4d5-4884-82b7-a73776764414 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.570773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.571498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.571751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.572118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.585225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.586916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:01.602961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:01.604152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:01.605387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:01.605387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:01.605387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:01.605387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 616/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:01.610062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.717674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563fb31-ee45-42e8-941d-f5cfef775d0f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.720321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.755062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.755671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.755979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.756252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.756916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:01.757213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.758567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.770339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 613/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:01.775982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:01.785560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:01.887118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb9f6a-0cfd-41b4-8c37-de5a928d02b7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:01.921775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:01.922419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:01.922703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:01.922978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:01.929766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:01.931227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:01.943381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:01.944485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:01.945627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 617/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:01.950647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.067683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2c8a5-ff11-47c5-ad85-596be0f83c7a None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.106009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9e47-f171-466b-ad94-6f8925c78c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.106618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9e47-f171-466b-ad94-6f8925c78c3d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.107465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9e47-f171-466b-ad94-6f8925c78c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.107866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9e47-f171-466b-ad94-6f8925c78c3d None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.108554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9e47-f171-466b-ad94-6f8925c78c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:02.108862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9e47-f171-466b-ad94-6f8925c78c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.110304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9e47-f171-466b-ad94-6f8925c78c3d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.122274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 614/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:02.128386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:02.201392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:02.239589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5056c-1498-43ba-85c8-848f8d7b3132 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:02.274284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c657b4d-737d-4830-9f81-f14d55af7800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:02.274970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657b4d-737d-4830-9f81-f14d55af7800 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.275289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657b4d-737d-4830-9f81-f14d55af7800 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.275553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c657b4d-737d-4830-9f81-f14d55af7800 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/1b4c5c17981649e8a4cffdb84cda0374/roles/9c4b8b10d69d46b8aa4ecc21408597f2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.291793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c657b4d-737d-4830-9f81-f14d55af7800 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=1b4c5c17981649e8a4cffdb84cda0374, role_id=9c4b8b10d69d46b8aa4ecc21408597f2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:02.293264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c657b4d-737d-4830-9f81-f14d55af7800 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:02.307654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 618/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:02 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/1b4c5c17981649e8a4cffdb84cda0374/roles/9c4b8b10d69d46b8aa4ecc21408597f2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:06:04.259068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcc4ba-1d76-4719-be67-757022d7c8ab None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.259630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcc4ba-1d76-4719-be67-757022d7c8ab None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.259630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcc4ba-1d76-4719-be67-757022d7c8ab None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.261007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 615/1233] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:04.267265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2e94-28fc-48b4-bdb7-2c518ecafae0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.267692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2e94-28fc-48b4-bdb7-2c518ecafae0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.267835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2e94-28fc-48b4-bdb7-2c518ecafae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.286753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-852b2e94-28fc-48b4-bdb7-2c518ecafae0 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:04.288637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-852b2e94-28fc-48b4-bdb7-2c518ecafae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:04.357830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 619/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:04.627877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcc4ba-1d76-4719-be67-757022d7c8ab None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:04.654304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:04.736423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcc4ba-1d76-4719-be67-757022d7c8ab None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:04.773088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:04.773844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.774195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.774537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.785234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:04.791198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:04.792503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:06:04.793476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:04.795964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 616/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Aug 17 16:06:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:04.799489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2e94-28fc-48b4-bdb7-2c518ecafae0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:04.861445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:04.921816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2e94-28fc-48b4-bdb7-2c518ecafae0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:04.965172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:04.965831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:04.966130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:04.966508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:04.967470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:04.967783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:04.969208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:04.978698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 620/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Aug 17 16:06:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:04.986977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.089667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:05.108743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cabc4-1768-4d89-9166-7e48889725c2 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.145900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.146544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.146835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.147100 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.157934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.159445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:05.174789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:05.181353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:05.182585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:05.182585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:05.182585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:05.182585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 617/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:05.182868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.292384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644fb62-31b8-4de3-83dd-6d61da9f74ec None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.302493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:05.330224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.330838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.331121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.331444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.332112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:05.332419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.333795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:05.346452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 621/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:05.352744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.470851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84920e-7c83-46e6-b086-cd636c6db7ed None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.508524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.509184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.509578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.510035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] PATH_INFO: `/v3/users/placement` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.513655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:05.520009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.521666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:05.536078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:05.537106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:05.538103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 618/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:05.543253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.650288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaaa19-9e4e-4195-a5b9-18459ea57a5e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.687117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.687728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.688038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.688315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.689049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:05.689357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.690792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:05.709777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 622/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:05.715620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:05.831320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0059cb-5d89-4b15-b061-369c9fef46de None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:05.870898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:05.871523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.871819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.872111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.945731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:05.955063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:05.956770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.081266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 619/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:06:06.087259 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.116824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.196745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561d7e-dfe1-449a-8ce5-7abdeb4f88c9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.238373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.239041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.239337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.239653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.252193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.253886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:06.271207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:06.272355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:06.273405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:06.273405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:06.273405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:06.273405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 623/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:06.278032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.385389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.392506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5345145-94b9-477a-af0d-4073cdca72e6 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.429061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.429860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.430182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.430535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.431354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:06.431676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.433417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.452207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 620/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:06.453432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.542152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.566423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfef97-79d3-4001-9d85-cf36162f4bf6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.604331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.605020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.605379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.605686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.613583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.615195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:06.628959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:06.630087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:06.631160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:06.632757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 624/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:06.640563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.750095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aec4c-cb70-49aa-8379-7dc60169bd70 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.788288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58332eb7-df0a-4a70-8d44-a2c20214bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.788897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332eb7-df0a-4a70-8d44-a2c20214bde0 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.789174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332eb7-df0a-4a70-8d44-a2c20214bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.789458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332eb7-df0a-4a70-8d44-a2c20214bde0 None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.790128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58332eb7-df0a-4a70-8d44-a2c20214bde0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:06.790444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58332eb7-df0a-4a70-8d44-a2c20214bde0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.792718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58332eb7-df0a-4a70-8d44-a2c20214bde0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.805168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 621/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:06.812262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.923625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334ddb3-7f56-4ddd-83c6-511a838e2411 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.962627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28201e7c-a6f7-4c75-abf2-49ce56ae2605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.963336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28201e7c-a6f7-4c75-abf2-49ce56ae2605 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.963648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28201e7c-a6f7-4c75-abf2-49ce56ae2605 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.964015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28201e7c-a6f7-4c75-abf2-49ce56ae2605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.964848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28201e7c-a6f7-4c75-abf2-49ce56ae2605 None admin] RBAC: Adding query filter params (role.id=9c4b8b10d69d46b8aa4ecc21408597f2, scope.project.id=316c09203d964b75a1da935349312a48, user.id=1b4c5c17981649e8a4cffdb84cda0374) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:06.965189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28201e7c-a6f7-4c75-abf2-49ce56ae2605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.966956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28201e7c-a6f7-4c75-abf2-49ce56ae2605 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.973402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 625/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/role_assignments?user.id=1b4c5c17981649e8a4cffdb84cda0374&scope.project.id=316c09203d964b75a1da935349312a48&role.id=9c4b8b10d69d46b8aa4ecc21408597f2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:09.021777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38037df8-4dd7-40d4-a2a2-1bdaa7b7e602 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.021777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38037df8-4dd7-40d4-a2a2-1bdaa7b7e602 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.021777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38037df8-4dd7-40d4-a2a2-1bdaa7b7e602 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.021777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 622/1247] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:09.025190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92469-403a-4676-9b5d-61773e3cc321 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.025617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92469-403a-4676-9b5d-61773e3cc321 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.025747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92469-403a-4676-9b5d-61773e3cc321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.034196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.049804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6bd92469-403a-4676-9b5d-61773e3cc321 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:09.051334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6bd92469-403a-4676-9b5d-61773e3cc321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:09.130341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 626/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:09.429329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38037df8-4dd7-40d4-a2a2-1bdaa7b7e602 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.449312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.548906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38037df8-4dd7-40d4-a2a2-1bdaa7b7e602 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.586657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.587384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.587695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.588142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.600583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:09.606270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:09.608761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:09.615833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 623/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.615966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92469-403a-4676-9b5d-61773e3cc321 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.727179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92469-403a-4676-9b5d-61773e3cc321 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.765128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.770598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.771281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.771592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.772166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.772965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:09.773375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.774878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.786364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 627/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:09.792549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:09.884010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:09.911947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba98c-1c43-4679-99c5-ab74dc7f2c54 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:09.949421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:09.950561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:09.950561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:09.950561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:09.963903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:09.965705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:09.984537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:09.985758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:09.986989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:09.986989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:09.986989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:09.986989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 624/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:09.992125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.120196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bdd80-19a8-4abf-b193-a7a1176500d6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.159477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.160121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.160400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.160673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.161309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:10.161609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.162958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.178150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 628/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:10.183827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.296578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2664f-7570-40a0-848b-01df724f7e61 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.330311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.342697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.343442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.343780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.344158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.354260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.357123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:10.371664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:10.373618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:10.374732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 625/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:10.379280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.441458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.489202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58277b-3bd4-4069-8956-c529e876ffd8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.526256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.526870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.527152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.527427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.528226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:10.528553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.529977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.549129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 629/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:10.554874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:10.661757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167eb5-f80b-4880-8a92-ad099b0f8347 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:10.708050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:10.708671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:10.708988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:10.709226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:10.774031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:10.790584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:10.792307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:10.905731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 626/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:06:10.911698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.036992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcefa32-f4a6-4fa2-864f-d91f8a7014e3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.053021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:11.079049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.079682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.079993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.080266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.092787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.094179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:11.109894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:11.111059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:11.111974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:11.111974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:11.111974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:11.111974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 630/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:11.116906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.207830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:11.222508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615498c-faa0-4ef8-9528-fef0ed93bc3e None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.260209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.260915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.261259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.261569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.262390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:11.262935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.264593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.276839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 627/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:11.282998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.393473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3007a25-de2c-4485-b809-98a8e4b01863 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.430722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.431446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.431790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.432186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.439244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.440719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:11.454123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:11.455304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:11.456273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 631/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:11.464312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.581725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724fe9-0bfd-40c9-a2b5-21d339fe35ad None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.618874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cc1c6-3daf-4f33-851d-c982d04326fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.619491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc1c6-3daf-4f33-851d-c982d04326fe None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.619781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc1c6-3daf-4f33-851d-c982d04326fe None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.620089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cc1c6-3daf-4f33-851d-c982d04326fe None admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.620790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cc1c6-3daf-4f33-851d-c982d04326fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:11.621095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cc1c6-3daf-4f33-851d-c982d04326fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.622969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cc1c6-3daf-4f33-851d-c982d04326fe None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.638417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 628/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:11.644827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:11.672406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:11.757055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0a975-6f3c-4fef-bf01-8c2705cbd74e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:11.793537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eb03b-5941-412d-867b-3dced0f2dabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:11.794899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb03b-5941-412d-867b-3dced0f2dabc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:11.795304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb03b-5941-412d-867b-3dced0f2dabc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:11.795538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eb03b-5941-412d-867b-3dced0f2dabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:11.796304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547eb03b-5941-412d-867b-3dced0f2dabc None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=316c09203d964b75a1da935349312a48, user.id=1b4c5c17981649e8a4cffdb84cda0374) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:11.796614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547eb03b-5941-412d-867b-3dced0f2dabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:11.798528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547eb03b-5941-412d-867b-3dced0f2dabc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:11.805721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 632/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:11 2022] GET /identity/v3/role_assignments?user.id=1b4c5c17981649e8a4cffdb84cda0374&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b73be4c438e74c73b714b299c1412271 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:13.812004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb50ae-9a02-422f-ac64-b4a8b16d9bcd None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.812571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb50ae-9a02-422f-ac64-b4a8b16d9bcd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.812571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb50ae-9a02-422f-ac64-b4a8b16d9bcd None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.813892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 629/1261] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:13.819015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444ea7-834c-4781-b401-8107fa0b7423 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:13.819383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444ea7-834c-4781-b401-8107fa0b7423 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:13.819575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444ea7-834c-4781-b401-8107fa0b7423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:13.837611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-65444ea7-834c-4781-b401-8107fa0b7423 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:13.838806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-65444ea7-834c-4781-b401-8107fa0b7423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:13.904953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 633/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:14.183480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb50ae-9a02-422f-ac64-b4a8b16d9bcd None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.194691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.283556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb50ae-9a02-422f-ac64-b4a8b16d9bcd None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.316333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.316946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.317228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.317504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.327316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:14.332056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:14.333146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:14.334167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 630/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:14.339186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444ea7-834c-4781-b401-8107fa0b7423 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.358372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.437053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444ea7-834c-4781-b401-8107fa0b7423 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.470737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.471333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.471612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.471912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.472573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:14.472876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.474222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.482466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 634/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:14.488200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.554276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.587016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3ab7d-7574-4411-9261-f720bda0ca55 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.619749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.620397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.620676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.620946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.631055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.632522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:14.646934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:14.648041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:14.649128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:14.649128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:14.649128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:14.649128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 631/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:14.654418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.733971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.752400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a900eb-748d-4d20-b455-bd050bda5ac8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.785650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.786249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.786529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.786797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.787428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:14.787727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.789094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.800702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 635/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:14.806237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:14.906292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79935-cda4-4589-89c2-ef43910a0c68 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:14.925240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:14.939556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:14.940278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:14.940557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:14.940829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:14.948056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:14.949503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:14.960949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:14.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:14.963224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 632/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:14.968319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.069977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fe23-46f4-41a4-b398-fee00be6a4e3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.103774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.104403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.104684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.104958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.105680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.105986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.107519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.115901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.125757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 636/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 17 16:06:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.131417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.227431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b47795-1fd2-498a-82de-ffe0c3f0c4a1 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.260217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.260836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.261113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.261385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.271431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.272899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:15.286618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:15.287737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:15.288880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:15.288880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:15.288880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:15.288880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 633/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:15.294103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.391731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af19254-4882-43d3-892e-373c6e596364 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.425414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.426002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.426285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.426555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.427186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.427485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.428854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.440312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 637/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.445935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.477033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.544466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8428ae-b174-4735-94ec-6c1c04173991 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.577048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.577668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.577948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.578223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.584668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.586104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:15.597706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:15.598752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:15.599882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 634/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:15.604884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.662674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.703424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a8264-49ff-4514-a9cc-be8060bafe3d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.736194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f395562-e8e2-4c8f-a34b-9f994f9dfef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.736782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f395562-e8e2-4c8f-a34b-9f994f9dfef4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.737060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f395562-e8e2-4c8f-a34b-9f994f9dfef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.737328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f395562-e8e2-4c8f-a34b-9f994f9dfef4 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.738009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f395562-e8e2-4c8f-a34b-9f994f9dfef4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:15.738311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f395562-e8e2-4c8f-a34b-9f994f9dfef4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.739700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f395562-e8e2-4c8f-a34b-9f994f9dfef4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.751182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 638/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:15.757172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:15.854447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:15.864131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac5dd-8cd5-4d7d-9794-76ba54893d4d None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:15.897053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9a7ce-4b56-4198-98c5-092098c15931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:15.897712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9a7ce-4b56-4198-98c5-092098c15931 None admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:15.897993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9a7ce-4b56-4198-98c5-092098c15931 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:15.898269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9a7ce-4b56-4198-98c5-092098c15931 None admin] PATH_INFO: `/v3/projects/316c09203d964b75a1da935349312a48/users/1b4c5c17981649e8a4cffdb84cda0374/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:15.900165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9a7ce-4b56-4198-98c5-092098c15931 None admin] RBAC: Authorizing `identity:create_grant(project_id=316c09203d964b75a1da935349312a48, user_id=1b4c5c17981649e8a4cffdb84cda0374, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:15.901618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9a7ce-4b56-4198-98c5-092098c15931 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:15.914272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 635/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Aug 17 16:06:15 2022] PUT /identity/v3/projects/316c09203d964b75a1da935349312a48/users/1b4c5c17981649e8a4cffdb84cda0374/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:06:17.803220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c391e1-8036-4902-94f3-422d188586df None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.803880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c391e1-8036-4902-94f3-422d188586df None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.803880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c391e1-8036-4902-94f3-422d188586df None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.805125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 639/1274] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:17.810191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a311dd-def2-49a6-81bb-f07a93adb53e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:17.810601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a311dd-def2-49a6-81bb-f07a93adb53e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:17.810742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a311dd-def2-49a6-81bb-f07a93adb53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:17.829150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c6a311dd-def2-49a6-81bb-f07a93adb53e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:17.830341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c6a311dd-def2-49a6-81bb-f07a93adb53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:17.896869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 636/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:18.169411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c391e1-8036-4902-94f3-422d188586df None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.269396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c391e1-8036-4902-94f3-422d188586df None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.285954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.303364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.304010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.304289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.304559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.315164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:06:18.319978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:18.321138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:18.322045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 640/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:18.327193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a311dd-def2-49a6-81bb-f07a93adb53e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.405221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.424179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a311dd-def2-49a6-81bb-f07a93adb53e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.457014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.457611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.457891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.458164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.458823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:18.459125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.460673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.468385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 637/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:18.474026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.572058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ebb-4ac4-42c0-b921-7961b0465737 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.606775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.607397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.607680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.607986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.617773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.619207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:18.634044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:18.635192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:18.636328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:18.636328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:18.636328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:18.636328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 641/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:06:18.641566 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.739257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21916020-20ec-4bb6-a650-88372a89d46b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.772087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.772684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.772967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.773246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.773888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:18.774196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.775565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.786886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 638/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:18.792322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.823527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:18.892221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d9222-4aae-452f-b63e-0b8c969ec468 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:18.924706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:18.925333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:18.925607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:18.925876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:18.933059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:18.935322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:06:18.945988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:18.947108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:18.948376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 642/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:18.953490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:18.957296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.053504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8699304-ae73-40d5-be09-2aab4dd01e45 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.086942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.087539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.087837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.088116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.088835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:19.089135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.090769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.109672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 639/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Aug 17 16:06:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:19.115572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.203582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.213355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df4e41-ce92-487c-a999-34ef6fae4899 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.245657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.246243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.246557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.247326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.312005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.313378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.399685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.410791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 643/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:06:19.416699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.477415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.515523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55d9b4-be28-4c1a-8440-9c43ec75a898 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.548581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.549197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.549481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.549753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.559271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.560742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:06:19.574659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:19.575947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:06:19.577144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:06:19.577144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:06:19.577144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:19.577144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 640/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:19.581349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.677986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14897c4-1001-4411-ba8e-7995e10c00cb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.711390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.712021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.712305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.712580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.713222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:19.713527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.714878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.726780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 644/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:19.732627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.829162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f601f5-4fe9-4521-a861-1cfcab80a68f None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:19.842973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.863246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:19.864004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:19.864286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:19.864556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:19.870929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:19.872516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:06:19.883279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:19.884360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: ERROR keystone.server.flask.application Aug 17 16:06:19.889244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 641/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:19.890946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:19.940262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:19.990777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df833902-36c1-4241-b13b-30b693d2a99d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:20.025149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d09af2-1894-49ff-bc54-b9e241ae9d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:20.025788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d09af2-1894-49ff-bc54-b9e241ae9d5f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.026177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d09af2-1894-49ff-bc54-b9e241ae9d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.026438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d09af2-1894-49ff-bc54-b9e241ae9d5f None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.027203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d09af2-1894-49ff-bc54-b9e241ae9d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:20.027546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d09af2-1894-49ff-bc54-b9e241ae9d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:20.029975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d09af2-1894-49ff-bc54-b9e241ae9d5f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:20.044019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 645/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Aug 17 16:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:20.050132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:20.148969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69446-594e-491d-b4ca-799dc6309d65 None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:20.181197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51185d-0ff9-4b4d-8a82-aca7eed5388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:20.181794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51185d-0ff9-4b4d-8a82-aca7eed5388b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:20.182075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51185d-0ff9-4b4d-8a82-aca7eed5388b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:20.182348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51185d-0ff9-4b4d-8a82-aca7eed5388b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:20.183071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51185d-0ff9-4b4d-8a82-aca7eed5388b None admin] RBAC: Adding query filter params (role.id=b73be4c438e74c73b714b299c1412271, scope.project.id=316c09203d964b75a1da935349312a48, user.id=1b4c5c17981649e8a4cffdb84cda0374) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:20.183382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51185d-0ff9-4b4d-8a82-aca7eed5388b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:20.185380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51185d-0ff9-4b4d-8a82-aca7eed5388b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:20.190925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 642/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Aug 17 16:06:20 2022] GET /identity/v3/role_assignments?user.id=1b4c5c17981649e8a4cffdb84cda0374&scope.project.id=316c09203d964b75a1da935349312a48&role.id=b73be4c438e74c73b714b299c1412271 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:22.096855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd51d-a936-4859-996c-1cab5c367beb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.097373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd51d-a936-4859-996c-1cab5c367beb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.097373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd51d-a936-4859-996c-1cab5c367beb None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.098635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 646/1288] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:22.104074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07e50-ff91-4ac0-9399-7fd92ba0bf5b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.104490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07e50-ff91-4ac0-9399-7fd92ba0bf5b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.104624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07e50-ff91-4ac0-9399-7fd92ba0bf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.123498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-eac07e50-ff91-4ac0-9399-7fd92ba0bf5b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:22.124721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-eac07e50-ff91-4ac0-9399-7fd92ba0bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:22.153474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.193666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 643/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:22.460588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbd51d-a936-4859-996c-1cab5c367beb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.563445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbd51d-a936-4859-996c-1cab5c367beb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.574156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:22.597399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.598025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.598304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.598576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.599154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.600543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:22.609461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:22.610731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:22.611924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 647/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:22.616666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07e50-ff91-4ac0-9399-7fd92ba0bf5b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.712960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07e50-ff91-4ac0-9399-7fd92ba0bf5b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.745944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed2a09-d4e3-471b-ab58-257be31af2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.747113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed2a09-d4e3-471b-ab58-257be31af2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.747395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed2a09-d4e3-471b-ab58-257be31af2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.747666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed2a09-d4e3-471b-ab58-257be31af2d0 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.748322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed2a09-d4e3-471b-ab58-257be31af2d0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:22.748627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed2a09-d4e3-471b-ab58-257be31af2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.749987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed2a09-d4e3-471b-ab58-257be31af2d0 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.754675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 644/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:22.760445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:22.858621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ff29a-9cad-4e08-9584-f579313ce732 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:22.891666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d3c85-01e3-4f67-ad65-9de5eb5cb7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:22.892307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3c85-01e3-4f67-ad65-9de5eb5cb7da None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:22.892591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3c85-01e3-4f67-ad65-9de5eb5cb7da None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:22.892868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d3c85-01e3-4f67-ad65-9de5eb5cb7da None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:22.893505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d3c85-01e3-4f67-ad65-9de5eb5cb7da None admin] RBAC: Adding query filter params (type=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:22.893812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d3c85-01e3-4f67-ad65-9de5eb5cb7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:22.895168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d3c85-01e3-4f67-ad65-9de5eb5cb7da None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:22.899675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 648/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 17 16:06:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:06:24.787866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cdbe5-7b53-4bff-9053-0f811106e836 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.788421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cdbe5-7b53-4bff-9053-0f811106e836 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.788421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cdbe5-7b53-4bff-9053-0f811106e836 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.789734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 645/1293] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:24.794987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb8a92-b9c3-422c-b2e5-a863023599c8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:24.795412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb8a92-b9c3-422c-b2e5-a863023599c8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:24.795534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb8a92-b9c3-422c-b2e5-a863023599c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:24.814072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7dfb8a92-b9c3-422c-b2e5-a863023599c8 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:24.815280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7dfb8a92-b9c3-422c-b2e5-a863023599c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:24.853595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:24.891333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 649/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:25.169582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cdbe5-7b53-4bff-9053-0f811106e836 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:25.204576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:25.277781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cdbe5-7b53-4bff-9053-0f811106e836 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:25.311060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3253bc1-4962-47f7-8ea3-358aca6e679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:25.311664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3253bc1-4962-47f7-8ea3-358aca6e679d None admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:25.311981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3253bc1-4962-47f7-8ea3-358aca6e679d None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:25.312259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3253bc1-4962-47f7-8ea3-358aca6e679d None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:25.312897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3253bc1-4962-47f7-8ea3-358aca6e679d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:25.314260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3253bc1-4962-47f7-8ea3-358aca6e679d None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:25.327883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 646/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:25 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:27.230297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67299-aa7d-4f08-8475-4511789d35a1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.231444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67299-aa7d-4f08-8475-4511789d35a1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.231444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67299-aa7d-4f08-8475-4511789d35a1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.232773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 650/1296] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:27.238031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74daf3-6d02-46d4-b3d4-e6f7193e9d36 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.238427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74daf3-6d02-46d4-b3d4-e6f7193e9d36 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.238585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74daf3-6d02-46d4-b3d4-e6f7193e9d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.257220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-eb74daf3-6d02-46d4-b3d4-e6f7193e9d36 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:27.258436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-eb74daf3-6d02-46d4-b3d4-e6f7193e9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:27.329724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 647/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:27.593949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67299-aa7d-4f08-8475-4511789d35a1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.693014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67299-aa7d-4f08-8475-4511789d35a1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.727223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.727876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.728160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.728434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.729022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.730382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:27.739152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:27.740337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:27.741372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 651/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:27.746711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74daf3-6d02-46d4-b3d4-e6f7193e9d36 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.765151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:27.845310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74daf3-6d02-46d4-b3d4-e6f7193e9d36 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:27.878367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:27.878972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:27.879252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:27.879527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:27.880186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:27.880493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:27.881859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:27.887502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 648/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:27.893416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:27.925656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:27.993769 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1237cd-ef79-4cc7-82dc-0ef528b9953b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.027217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc2e4-a9e8-4de3-b9a9-56310769b046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.028000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc2e4-a9e8-4de3-b9a9-56310769b046 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.028278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc2e4-a9e8-4de3-b9a9-56310769b046 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.028549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc2e4-a9e8-4de3-b9a9-56310769b046 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.029253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc2e4-a9e8-4de3-b9a9-56310769b046 None admin] RBAC: Adding query filter params (interface=public, service_id=fe2f819d4f524645bf7075afda15b187, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:28.029583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc2e4-a9e8-4de3-b9a9-56310769b046 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.030934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc2e4-a9e8-4de3-b9a9-56310769b046 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.035853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 652/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:27 2022] GET /identity/v3/endpoints?service_id=fe2f819d4f524645bf7075afda15b187&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:28.041670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:28.123024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:28.141089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d0768-30d8-4523-a3c6-1cb1e8a0620b None admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:28.173870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026aa9-d0bd-4b5f-b194-83b2be9f7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:28.174463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026aa9-d0bd-4b5f-b194-83b2be9f7e87 None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:28.174743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026aa9-d0bd-4b5f-b194-83b2be9f7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:28.175015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026aa9-d0bd-4b5f-b194-83b2be9f7e87 None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:28.175615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026aa9-d0bd-4b5f-b194-83b2be9f7e87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:28.176999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026aa9-d0bd-4b5f-b194-83b2be9f7e87 None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:28.183507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 649/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:28 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:06:30.074125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55085cee-4760-4a8c-9edd-a5591064ef3d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.075442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55085cee-4760-4a8c-9edd-a5591064ef3d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.075442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55085cee-4760-4a8c-9edd-a5591064ef3d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.076601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 653/1302] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:30.081736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22686e70-740f-4886-a3f8-32642925eacb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.082177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22686e70-740f-4886-a3f8-32642925eacb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.082273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22686e70-740f-4886-a3f8-32642925eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.100434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-22686e70-740f-4886-a3f8-32642925eacb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:30.101822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-22686e70-740f-4886-a3f8-32642925eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:30.166267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 650/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:30.442935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55085cee-4760-4a8c-9edd-a5591064ef3d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.537543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:30.544502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55085cee-4760-4a8c-9edd-a5591064ef3d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.576794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.577404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.577679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.577947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.578520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.579889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:30.588291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:30.589441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: ERROR keystone.server.flask.application Aug 17 16:06:30.591234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 654/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:30.596006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22686e70-740f-4886-a3f8-32642925eacb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.670184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:30.692893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22686e70-740f-4886-a3f8-32642925eacb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.726293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcd609-7244-4b12-a3c5-35bde2ad47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.726834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd609-7244-4b12-a3c5-35bde2ad47ac None admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.727114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd609-7244-4b12-a3c5-35bde2ad47ac None admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.727388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcd609-7244-4b12-a3c5-35bde2ad47ac None admin] PATH_INFO: `/v3/services` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.728041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd609-7244-4b12-a3c5-35bde2ad47ac None admin] RBAC: Adding query filter params (name=placement) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:30.728347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd609-7244-4b12-a3c5-35bde2ad47ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.729717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcd609-7244-4b12-a3c5-35bde2ad47ac None admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.734893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 651/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Aug 17 16:06:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:30.740615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:30.839387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fb92c-8d65-45aa-bc35-10d1e7cbab6b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:30.879939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5be9-25ce-4792-be11-bdd1b6fd34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:30.880544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5be9-25ce-4792-be11-bdd1b6fd34ae None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:30.880822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5be9-25ce-4792-be11-bdd1b6fd34ae None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:30.881096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5be9-25ce-4792-be11-bdd1b6fd34ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:30.881763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5be9-25ce-4792-be11-bdd1b6fd34ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:30.883147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5be9-25ce-4792-be11-bdd1b6fd34ae None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:30.902254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 655/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:40.731969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=30 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:40.898098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:34.359517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f6860-3f1b-44e4-b88c-2bd0b5c5f8b7 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:34.360086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f6860-3f1b-44e4-b88c-2bd0b5c5f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:34.360086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f6860-3f1b-44e4-b88c-2bd0b5c5f8b7 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:34.365331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 652/1307] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:34.366661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157e0c-ecc5-4ed6-933d-2be350d50cee None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:34.367081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157e0c-ecc5-4ed6-933d-2be350d50cee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:34.367218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157e0c-ecc5-4ed6-933d-2be350d50cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:34.476266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-58157e0c-ecc5-4ed6-933d-2be350d50cee None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:34.479838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-58157e0c-ecc5-4ed6-933d-2be350d50cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:34.624707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 656/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:34.930479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b000ac-86f9-4780-9529-c8b4be18ac45 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:34.930988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b000ac-86f9-4780-9529-c8b4be18ac45 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:34.931390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b000ac-86f9-4780-9529-c8b4be18ac45 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:34.933255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 653/1309] 10.222.0.60 () {54 vars in 965 bytes} [Wed Aug 17 16:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:34.938992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0aa9-5030-4c23-aa41-af4d029b4a1c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:34.939621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0aa9-5030-4c23-aa41-af4d029b4a1c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:34.940122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd0aa9-5030-4c23-aa41-af4d029b4a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:35.022290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-10fd0aa9-5030-4c23-aa41-af4d029b4a1c None None] MFA Rules not processed for user `13729a757e1a4f95a957fedb84705960`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:35.023896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-10fd0aa9-5030-4c23-aa41-af4d029b4a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:35.047521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:35.109568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 657/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Aug 17 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:35.119139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b000ac-86f9-4780-9529-c8b4be18ac45 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:35.120929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a2b000ac-86f9-4780-9529-c8b4be18ac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:35.234550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b000ac-86f9-4780-9529-c8b4be18ac45 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:35.317115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1305db-9915-404a-a442-99472ced1ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:35.318035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1305db-9915-404a-a442-99472ced1ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:35.318464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1305db-9915-404a-a442-99472ced1ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:35.318904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1305db-9915-404a-a442-99472ced1ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:35.320663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bc1305db-9915-404a-a442-99472ced1ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:35.387156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:35.452131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1305db-9915-404a-a442-99472ced1ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:35.453936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1305db-9915-404a-a442-99472ced1ba1 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:35.475358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 654/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:37.750741 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95b0f-ca10-4979-a120-9ee483fa19bf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:37.751258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95b0f-ca10-4979-a120-9ee483fa19bf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:37.751338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95b0f-ca10-4979-a120-9ee483fa19bf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:37.755848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 658/1312] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:37.757945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10bec-cf80-40b2-9797-d67fefb16d79 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:37.758897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10bec-cf80-40b2-9797-d67fefb16d79 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:37.759106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d10bec-cf80-40b2-9797-d67fefb16d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:37.843015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-64d10bec-cf80-40b2-9797-d67fefb16d79 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:37.844300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-64d10bec-cf80-40b2-9797-d67fefb16d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:37.955930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 655/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:38.239653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95b0f-ca10-4979-a120-9ee483fa19bf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:38.241225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2ac95b0f-ca10-4979-a120-9ee483fa19bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:38.345454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95b0f-ca10-4979-a120-9ee483fa19bf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:38.416164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:38.419072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cba3d-ef1c-4d5a-91c0-64f5572f1ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:38.419782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cba3d-ef1c-4d5a-91c0-64f5572f1ece service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:38.420282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cba3d-ef1c-4d5a-91c0-64f5572f1ece service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:38.420729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cba3d-ef1c-4d5a-91c0-64f5572f1ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:38.422582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-376cba3d-ef1c-4d5a-91c0-64f5572f1ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:38.531699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cba3d-ef1c-4d5a-91c0-64f5572f1ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:38.533084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cba3d-ef1c-4d5a-91c0-64f5572f1ece service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:38.551731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 659/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:07:40.780110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83954-7ddf-401d-ad99-179881727962 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:40.780646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83954-7ddf-401d-ad99-179881727962 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:40.780646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83954-7ddf-401d-ad99-179881727962 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:40.781993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 656/1315] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:40.787008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fddb76-47a1-4915-bceb-4cf9b8ea1018 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:40.787388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fddb76-47a1-4915-bceb-4cf9b8ea1018 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:40.787567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fddb76-47a1-4915-bceb-4cf9b8ea1018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:40.854012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-30fddb76-47a1-4915-bceb-4cf9b8ea1018 None None] MFA Rules not processed for user `1c3268fd2eb846f4bc4b8245f9be0583`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:40.855228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-30fddb76-47a1-4915-bceb-4cf9b8ea1018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:40.909515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:40.954848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 660/1316] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:41.244217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83954-7ddf-401d-ad99-179881727962 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:41.245752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-faf83954-7ddf-401d-ad99-179881727962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:41.255435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:41.349393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83954-7ddf-401d-ad99-179881727962 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:41.424308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cde7c-4a18-4438-b0d8-89c283b533f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:41.424920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cde7c-4a18-4438-b0d8-89c283b533f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:41.425205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cde7c-4a18-4438-b0d8-89c283b533f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:41.425478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cde7c-4a18-4438-b0d8-89c283b533f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:41.427098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f87cde7c-4a18-4438-b0d8-89c283b533f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:41.488424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:41.535472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cde7c-4a18-4438-b0d8-89c283b533f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:41.536941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cde7c-4a18-4438-b0d8-89c283b533f8 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:41.555791 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 657/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:44.062538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b8e9-837d-4f73-8f20-e376faeaf34f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.063064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b8e9-837d-4f73-8f20-e376faeaf34f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.063180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b8e9-837d-4f73-8f20-e376faeaf34f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.064481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 661/1318] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:44.069475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e7ab-828f-4fa6-8374-0b112631eb5b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.069885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e7ab-828f-4fa6-8374-0b112631eb5b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.070039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69e7ab-828f-4fa6-8374-0b112631eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.137003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4b69e7ab-828f-4fa6-8374-0b112631eb5b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:44.138213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4b69e7ab-828f-4fa6-8374-0b112631eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:44.232912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 658/1319] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:44.541730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955f97-e178-443b-bb96-d16886b1f047 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.542013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955f97-e178-443b-bb96-d16886b1f047 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.542289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29955f97-e178-443b-bb96-d16886b1f047 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.543621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 662/1320] 10.222.0.60 () {54 vars in 965 bytes} [Wed Aug 17 16:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:44.549800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b613c9-edf2-4285-9092-436760b59e22 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.550085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b613c9-edf2-4285-9092-436760b59e22 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.550359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b613c9-edf2-4285-9092-436760b59e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.572671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:44.631540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-02b613c9-edf2-4285-9092-436760b59e22 None None] MFA Rules not processed for user `13729a757e1a4f95a957fedb84705960`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:44.632785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-02b613c9-edf2-4285-9092-436760b59e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:44.707321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 659/1321] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Aug 17 16:07:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:44.716400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955f97-e178-443b-bb96-d16886b1f047 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:44.717963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-29955f97-e178-443b-bb96-d16886b1f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:44.823187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29955f97-e178-443b-bb96-d16886b1f047 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:44.895965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0611b41-f3c8-4caf-b256-a0a5eeedb3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:44.896565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0611b41-f3c8-4caf-b256-a0a5eeedb3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:44.896840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0611b41-f3c8-4caf-b256-a0a5eeedb3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:44.897108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0611b41-f3c8-4caf-b256-a0a5eeedb3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:44.899228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e0611b41-f3c8-4caf-b256-a0a5eeedb3a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:44.907404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:45.014096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0611b41-f3c8-4caf-b256-a0a5eeedb3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:45.015530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0611b41-f3c8-4caf-b256-a0a5eeedb3a1 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:45.034414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 663/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:48.068077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14cd8-2f61-4978-8e31-71ed67cc8e1b None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:48.068632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14cd8-2f61-4978-8e31-71ed67cc8e1b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:48.068632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a14cd8-2f61-4978-8e31-71ed67cc8e1b None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:48.070006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 660/1323] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:48.075759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355600-5cc4-4de5-86df-11e32bb8f206 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:48.076229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355600-5cc4-4de5-86df-11e32bb8f206 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:48.076332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd355600-5cc4-4de5-86df-11e32bb8f206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:48.143560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fd355600-5cc4-4de5-86df-11e32bb8f206 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:48.144794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fd355600-5cc4-4de5-86df-11e32bb8f206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:48.203791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:48.245404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 664/1324] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:48.543851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14cd8-2f61-4978-8e31-71ed67cc8e1b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:48.545403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-34a14cd8-2f61-4978-8e31-71ed67cc8e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:48.653382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a14cd8-2f61-4978-8e31-71ed67cc8e1b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:48.665797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:48.727971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68527c-cc20-4b4a-b7fb-df13ba452df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:48.728516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68527c-cc20-4b4a-b7fb-df13ba452df6 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:48.728863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68527c-cc20-4b4a-b7fb-df13ba452df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:48.729138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68527c-cc20-4b4a-b7fb-df13ba452df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:48.730765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bc68527c-cc20-4b4a-b7fb-df13ba452df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:48.845941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68527c-cc20-4b4a-b7fb-df13ba452df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:48.847380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68527c-cc20-4b4a-b7fb-df13ba452df6 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:48.865613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 661/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:50.845728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab00be-4667-4342-b062-5562cc1f7fbd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:50.846234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab00be-4667-4342-b062-5562cc1f7fbd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:50.846334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab00be-4667-4342-b062-5562cc1f7fbd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:50.847614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 665/1326] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:50.853033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492b2a-4d4c-4bd6-8b60-915be412d2a6 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:50.853487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492b2a-4d4c-4bd6-8b60-915be412d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:50.853593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492b2a-4d4c-4bd6-8b60-915be412d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:50.902608 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:50.921151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-05492b2a-4d4c-4bd6-8b60-915be412d2a6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:50.922371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-05492b2a-4d4c-4bd6-8b60-915be412d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:51.019849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 662/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:51.303588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab00be-4667-4342-b062-5562cc1f7fbd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:51.305729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-90ab00be-4667-4342-b062-5562cc1f7fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:51.422554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab00be-4667-4342-b062-5562cc1f7fbd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:51.498044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002698-e180-4812-822d-960ed09c2c01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:51.498663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002698-e180-4812-822d-960ed09c2c01 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:51.498944 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002698-e180-4812-822d-960ed09c2c01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:51.499216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002698-e180-4812-822d-960ed09c2c01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:51.500879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6a002698-e180-4812-822d-960ed09c2c01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:51.518120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:51.611098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002698-e180-4812-822d-960ed09c2c01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:51.612548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002698-e180-4812-822d-960ed09c2c01 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:51.630216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 666/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:53.592954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3419b0-c300-45fa-bd8e-c8774cfdba92 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:53.593540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3419b0-c300-45fa-bd8e-c8774cfdba92 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:53.593540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3419b0-c300-45fa-bd8e-c8774cfdba92 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:53.594884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 663/1329] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:53.600967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4d4cd-fc2e-49fe-af00-f9da717a7c26 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:53.601580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4d4cd-fc2e-49fe-af00-f9da717a7c26 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:53.602204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4d4cd-fc2e-49fe-af00-f9da717a7c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:53.668557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a7b4d4cd-fc2e-49fe-af00-f9da717a7c26 None None] MFA Rules not processed for user `1c3268fd2eb846f4bc4b8245f9be0583`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:53.669752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7b4d4cd-fc2e-49fe-af00-f9da717a7c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:53.734129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:53.766976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 667/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:54.050211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3419b0-c300-45fa-bd8e-c8774cfdba92 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:54.051899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6e3419b0-c300-45fa-bd8e-c8774cfdba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:54.165806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3419b0-c300-45fa-bd8e-c8774cfdba92 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:54.185802 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:54.245382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fbf84-8f29-4cda-9547-0987e4edb006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:54.246098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fbf84-8f29-4cda-9547-0987e4edb006 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:54.246506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fbf84-8f29-4cda-9547-0987e4edb006 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:54.246627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fbf84-8f29-4cda-9547-0987e4edb006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:54.248325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-232fbf84-8f29-4cda-9547-0987e4edb006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:54.365652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fbf84-8f29-4cda-9547-0987e4edb006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:54.367465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fbf84-8f29-4cda-9547-0987e4edb006 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:54.387628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 664/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:56.621319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf997-66b9-4f56-8f09-3bbc9ee4d673 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:56.621860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf997-66b9-4f56-8f09-3bbc9ee4d673 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:56.621860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf997-66b9-4f56-8f09-3bbc9ee4d673 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:56.623195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 668/1332] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:56.628227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a59a-f3c2-4645-814f-af447e50e6af None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:56.628629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a59a-f3c2-4645-814f-af447e50e6af None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:56.628781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0a59a-f3c2-4645-814f-af447e50e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:56.691531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:56.694233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-dcb0a59a-f3c2-4645-814f-af447e50e6af None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:56.696158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dcb0a59a-f3c2-4645-814f-af447e50e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:56.791315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 665/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:57.074619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf997-66b9-4f56-8f09-3bbc9ee4d673 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:57.076190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e27bf997-66b9-4f56-8f09-3bbc9ee4d673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:57.179107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bf997-66b9-4f56-8f09-3bbc9ee4d673 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:57.252612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1291b-4c5f-4c09-90f2-b385ce2b3150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:57.253214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1291b-4c5f-4c09-90f2-b385ce2b3150 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:57.253491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1291b-4c5f-4c09-90f2-b385ce2b3150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:57.253760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1291b-4c5f-4c09-90f2-b385ce2b3150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:57.255325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-acc1291b-4c5f-4c09-90f2-b385ce2b3150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:57.282643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:57.368138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1291b-4c5f-4c09-90f2-b385ce2b3150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:57.369582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1291b-4c5f-4c09-90f2-b385ce2b3150 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:57.387725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 669/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:59.348872 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eb116-b8f2-4efd-9652-750e6af62240 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.349727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eb116-b8f2-4efd-9652-750e6af62240 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.349727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709eb116-b8f2-4efd-9652-750e6af62240 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.351032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 666/1335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:59.356884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512cbf-347f-4bfb-a6dc-6fc895571cee None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.357324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512cbf-347f-4bfb-a6dc-6fc895571cee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.357461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c512cbf-347f-4bfb-a6dc-6fc895571cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.422863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9c512cbf-347f-4bfb-a6dc-6fc895571cee None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:59.424076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9c512cbf-347f-4bfb-a6dc-6fc895571cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:59.499072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:59.521981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 670/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:59.809007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eb116-b8f2-4efd-9652-750e6af62240 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:59.810570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-709eb116-b8f2-4efd-9652-750e6af62240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:59.913443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709eb116-b8f2-4efd-9652-750e6af62240 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:59.943154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:59.994021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a56f-7c9c-4cca-8d50-00d8ef9a4723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:59.994622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a56f-7c9c-4cca-8d50-00d8ef9a4723 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.994899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a56f-7c9c-4cca-8d50-00d8ef9a4723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.995168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a56f-7c9c-4cca-8d50-00d8ef9a4723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.996802 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e7c7a56f-7c9c-4cca-8d50-00d8ef9a4723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:00.105519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7a56f-7c9c-4cca-8d50-00d8ef9a4723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:00.106965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7a56f-7c9c-4cca-8d50-00d8ef9a4723 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:00.125051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 667/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:02.424652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34904a-66ae-4297-bbe7-27339ba1ed95 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:02.425186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34904a-66ae-4297-bbe7-27339ba1ed95 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:02.425186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34904a-66ae-4297-bbe7-27339ba1ed95 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:02.426526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 671/1338] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:02.432172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79ace6-f7f3-48ec-8472-eaa123ac4b9e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:02.432575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79ace6-f7f3-48ec-8472-eaa123ac4b9e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:02.432726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79ace6-f7f3-48ec-8472-eaa123ac4b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:02.498338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cf79ace6-f7f3-48ec-8472-eaa123ac4b9e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:02.499467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cf79ace6-f7f3-48ec-8472-eaa123ac4b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:02.507717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:02.595001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 668/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:02.887024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34904a-66ae-4297-bbe7-27339ba1ed95 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:02.888608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-de34904a-66ae-4297-bbe7-27339ba1ed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:02.993155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34904a-66ae-4297-bbe7-27339ba1ed95 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:03.067034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525e8a-7aa9-4f9a-ac6b-e5ff66f7fe1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:03.067662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525e8a-7aa9-4f9a-ac6b-e5ff66f7fe1f service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:03.067968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525e8a-7aa9-4f9a-ac6b-e5ff66f7fe1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:03.068237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525e8a-7aa9-4f9a-ac6b-e5ff66f7fe1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:03.069942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2d525e8a-7aa9-4f9a-ac6b-e5ff66f7fe1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:03.107578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:03.180869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525e8a-7aa9-4f9a-ac6b-e5ff66f7fe1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:03.182281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525e8a-7aa9-4f9a-ac6b-e5ff66f7fe1f service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:03.200342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 672/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:07.057115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c9ba6-f8b4-4687-b78a-5393ee45a1d5 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:07.057613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c9ba6-f8b4-4687-b78a-5393ee45a1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:07.057613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c9ba6-f8b4-4687-b78a-5393ee45a1d5 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:07.058948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 669/1341] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:07.064419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5553348-22f5-4a7c-9894-1ed03c4725a4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:07.064891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5553348-22f5-4a7c-9894-1ed03c4725a4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:07.065130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5553348-22f5-4a7c-9894-1ed03c4725a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:07.134433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c5553348-22f5-4a7c-9894-1ed03c4725a4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:07.135647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c5553348-22f5-4a7c-9894-1ed03c4725a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:07.223554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:07.236407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 673/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:07.522224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c9ba6-f8b4-4687-b78a-5393ee45a1d5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:07.523995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-119c9ba6-f8b4-4687-b78a-5393ee45a1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:07.628340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c9ba6-f8b4-4687-b78a-5393ee45a1d5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:07.680290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:07.717862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e5894-15f9-476b-8077-801a157b3490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:07.718474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5894-15f9-476b-8077-801a157b3490 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:07.718751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5894-15f9-476b-8077-801a157b3490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:07.719022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e5894-15f9-476b-8077-801a157b3490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:07.720660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2c6e5894-15f9-476b-8077-801a157b3490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:07.839613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e5894-15f9-476b-8077-801a157b3490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:07.841109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e5894-15f9-476b-8077-801a157b3490 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:07.859933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 670/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:10.340539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ba5e6-9a4c-4497-98ec-c7c3679a27d5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:10.341088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ba5e6-9a4c-4497-98ec-c7c3679a27d5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:10.341088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ba5e6-9a4c-4497-98ec-c7c3679a27d5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:10.342432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 674/1344] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:10.348098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57150-289f-4f80-ab8a-8d1a2df46c93 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:10.348579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57150-289f-4f80-ab8a-8d1a2df46c93 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:10.348681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57150-289f-4f80-ab8a-8d1a2df46c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:10.420949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9be57150-289f-4f80-ab8a-8d1a2df46c93 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:10.422169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9be57150-289f-4f80-ab8a-8d1a2df46c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:10.440358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:10.520460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 671/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:10.808749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ba5e6-9a4c-4497-98ec-c7c3679a27d5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:10.810388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fa2ba5e6-9a4c-4497-98ec-c7c3679a27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:10.917897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ba5e6-9a4c-4497-98ec-c7c3679a27d5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:10.996859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cd7e7-1781-4bd1-b77c-52e33bb88374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:10.997471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd7e7-1781-4bd1-b77c-52e33bb88374 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:10.997753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd7e7-1781-4bd1-b77c-52e33bb88374 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:10.998028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cd7e7-1781-4bd1-b77c-52e33bb88374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:10.999661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-605cd7e7-1781-4bd1-b77c-52e33bb88374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:11.058021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:11.137506 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cd7e7-1781-4bd1-b77c-52e33bb88374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:11.138941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cd7e7-1781-4bd1-b77c-52e33bb88374 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:11.159324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 675/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:15.241932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348b255-20dd-4185-86b1-1e7f894d1767 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:15.242470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348b255-20dd-4185-86b1-1e7f894d1767 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:15.242470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348b255-20dd-4185-86b1-1e7f894d1767 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:15.243878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 672/1347] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:15.251437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8a32-32c7-45ae-b605-d2372168186e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:15.251963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8a32-32c7-45ae-b605-d2372168186e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:15.251963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8a32-32c7-45ae-b605-d2372168186e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:15.341158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c6cd8a32-32c7-45ae-b605-d2372168186e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:15.342406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c6cd8a32-32c7-45ae-b605-d2372168186e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:15.470140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:15.476029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 676/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:15.770465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348b255-20dd-4185-86b1-1e7f894d1767 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:15.772088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f348b255-20dd-4185-86b1-1e7f894d1767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:15.899729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348b255-20dd-4185-86b1-1e7f894d1767 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:15.947209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:15.972612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938e76b-f4d7-44d6-a8dd-c39a100e8783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:15.973223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938e76b-f4d7-44d6-a8dd-c39a100e8783 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:15.973501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938e76b-f4d7-44d6-a8dd-c39a100e8783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:15.973769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938e76b-f4d7-44d6-a8dd-c39a100e8783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:15.976215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3938e76b-f4d7-44d6-a8dd-c39a100e8783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:16.089507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938e76b-f4d7-44d6-a8dd-c39a100e8783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:16.090865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938e76b-f4d7-44d6-a8dd-c39a100e8783 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:16.109570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 673/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:08:21.057515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527293-2553-469c-be5d-5a7238d6f802 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:21.058049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527293-2553-469c-be5d-5a7238d6f802 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:21.058049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527293-2553-469c-be5d-5a7238d6f802 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:21.059974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 677/1350] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:21.064824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128a17-5bc5-4c41-aa51-6e5ee202b64f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:21.065229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128a17-5bc5-4c41-aa51-6e5ee202b64f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:21.065373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128a17-5bc5-4c41-aa51-6e5ee202b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:21.155385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ca128a17-5bc5-4c41-aa51-6e5ee202b64f None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:21.156641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ca128a17-5bc5-4c41-aa51-6e5ee202b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:21.176018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:21.344850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 674/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:08:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:25.537800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1bab4-cae8-42ad-b230-c56a017cb29c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:25.538794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1bab4-cae8-42ad-b230-c56a017cb29c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:25.539230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1bab4-cae8-42ad-b230-c56a017cb29c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:25.541235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 678/1352] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:08:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:25.546495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887634f-2139-4f50-90e3-533b54c0f0f7 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:25.546942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887634f-2139-4f50-90e3-533b54c0f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:25.547089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887634f-2139-4f50-90e3-533b54c0f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:25.629515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4887634f-2139-4f50-90e3-533b54c0f0f7 None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:25.630750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4887634f-2139-4f50-90e3-533b54c0f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:25.705618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:25.746356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 675/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:08:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:27.209127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d681d-cef4-473e-b33f-05c78431164d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:27.209681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d681d-cef4-473e-b33f-05c78431164d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:27.209681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d681d-cef4-473e-b33f-05c78431164d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:27.211008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 679/1354] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:27.216879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fa32d-601a-4f4b-a2a1-f2d4b0ba2091 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:27.217324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fa32d-601a-4f4b-a2a1-f2d4b0ba2091 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:27.217443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fa32d-601a-4f4b-a2a1-f2d4b0ba2091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:27.296704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f74fa32d-601a-4f4b-a2a1-f2d4b0ba2091 None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:27.297926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f74fa32d-601a-4f4b-a2a1-f2d4b0ba2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:27.405835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 676/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:08:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:30.655219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c00f0-9eb0-49d2-a387-c17f597d1a6f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:30.656068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c00f0-9eb0-49d2-a387-c17f597d1a6f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:30.656068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c00f0-9eb0-49d2-a387-c17f597d1a6f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:30.657117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 680/1356] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:30.662262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd1c3-91e2-4c70-bd4f-dc913df8b1e9 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:30.662652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd1c3-91e2-4c70-bd4f-dc913df8b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:30.662809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd1c3-91e2-4c70-bd4f-dc913df8b1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:30.698799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:30.752198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c4ddd1c3-91e2-4c70-bd4f-dc913df8b1e9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:30.753406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c4ddd1c3-91e2-4c70-bd4f-dc913df8b1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:30.895860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 677/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:31.208951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684720d-eec0-4da3-9e78-54f7c063bd0b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.209569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684720d-eec0-4da3-9e78-54f7c063bd0b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.211056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684720d-eec0-4da3-9e78-54f7c063bd0b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.213653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 681/1358] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 17 16:08:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:31.223029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc462f1-1840-49ab-9895-fa9a53188232 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.223318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc462f1-1840-49ab-9895-fa9a53188232 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.223665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc462f1-1840-49ab-9895-fa9a53188232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.336572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-bdc462f1-1840-49ab-9895-fa9a53188232 None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:31.337789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bdc462f1-1840-49ab-9895-fa9a53188232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:31.394122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:31.465753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 678/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 17 16:08:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:31.473401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684720d-eec0-4da3-9e78-54f7c063bd0b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:31.475173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4684720d-eec0-4da3-9e78-54f7c063bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:31.632432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684720d-eec0-4da3-9e78-54f7c063bd0b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:31.710726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:31.753715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d26ec-19c8-4588-8680-fb71b11111d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:31.754237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d26ec-19c8-4588-8680-fb71b11111d8 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.754517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d26ec-19c8-4588-8680-fb71b11111d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.754788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d26ec-19c8-4588-8680-fb71b11111d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.756402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1e7d26ec-19c8-4588-8680-fb71b11111d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:31.854259 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d26ec-19c8-4588-8680-fb71b11111d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:31.855907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d26ec-19c8-4588-8680-fb71b11111d8 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:31.876425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 682/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:33.997891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709a33-ed3e-41bd-ab09-6e796aad4dc5 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:33.998547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709a33-ed3e-41bd-ab09-6e796aad4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:33.998547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709a33-ed3e-41bd-ab09-6e796aad4dc5 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:34.004171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 679/1361] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:34.005276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b6b2-c20a-4b86-88da-1fc5c8309d5e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:34.005716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b6b2-c20a-4b86-88da-1fc5c8309d5e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:34.005800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6b6b2-c20a-4b86-88da-1fc5c8309d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:34.080319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-34f6b6b2-c20a-4b86-88da-1fc5c8309d5e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:34.081523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-34f6b6b2-c20a-4b86-88da-1fc5c8309d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:34.126023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:34.195888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 683/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:08:34.482299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c709a33-ed3e-41bd-ab09-6e796aad4dc5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:34.483676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5c709a33-ed3e-41bd-ab09-6e796aad4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:34.651352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c709a33-ed3e-41bd-ab09-6e796aad4dc5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:34.660732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:34.777246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accb292-16ec-4916-bbd6-5d34c53297f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:34.777779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accb292-16ec-4916-bbd6-5d34c53297f5 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:34.778067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accb292-16ec-4916-bbd6-5d34c53297f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:34.778339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accb292-16ec-4916-bbd6-5d34c53297f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:34.780154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0accb292-16ec-4916-bbd6-5d34c53297f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:34.897223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accb292-16ec-4916-bbd6-5d34c53297f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:34.899170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accb292-16ec-4916-bbd6-5d34c53297f5 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:34.925570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 680/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:37.182425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8591-690a-4441-aeb0-cd26982d6a1e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:37.183501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8591-690a-4441-aeb0-cd26982d6a1e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:37.183826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8591-690a-4441-aeb0-cd26982d6a1e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:37.185659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 684/1364] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:37.190526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb06cc-9739-4568-80c1-75b10560d7eb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:37.190969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb06cc-9739-4568-80c1-75b10560d7eb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:37.191146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb06cc-9739-4568-80c1-75b10560d7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:37.212855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:37.272899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-30cb06cc-9739-4568-80c1-75b10560d7eb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:37.274244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-30cb06cc-9739-4568-80c1-75b10560d7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:37.383879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 681/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:37.674353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702bd70-b28c-472d-aef4-2a5e5bbb86ff None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:37.674703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702bd70-b28c-472d-aef4-2a5e5bbb86ff None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:37.674922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702bd70-b28c-472d-aef4-2a5e5bbb86ff None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:37.676837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 685/1366] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 17 16:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:37.683404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863229da-845e-44d4-91a9-34c9f63e5cba None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:37.683778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863229da-845e-44d4-91a9-34c9f63e5cba None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:37.684152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863229da-845e-44d4-91a9-34c9f63e5cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:37.776896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-863229da-845e-44d4-91a9-34c9f63e5cba None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:37.778394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-863229da-845e-44d4-91a9-34c9f63e5cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:37.815255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:37.911289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 682/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 17 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:37.919903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702bd70-b28c-472d-aef4-2a5e5bbb86ff None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:37.921742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8702bd70-b28c-472d-aef4-2a5e5bbb86ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:38.083507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702bd70-b28c-472d-aef4-2a5e5bbb86ff None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:38.106518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:38.210456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266eb2-50f5-4f4c-8a84-9c1afcd66200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:38.211096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266eb2-50f5-4f4c-8a84-9c1afcd66200 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:38.211358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266eb2-50f5-4f4c-8a84-9c1afcd66200 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:38.211528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266eb2-50f5-4f4c-8a84-9c1afcd66200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:38.213206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6d266eb2-50f5-4f4c-8a84-9c1afcd66200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:38.308722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266eb2-50f5-4f4c-8a84-9c1afcd66200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:38.310651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266eb2-50f5-4f4c-8a84-9c1afcd66200 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:38.330194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 686/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:08:38.976393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2170-e5d5-4062-9c21-4304db5af1b6 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:38.976959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2170-e5d5-4062-9c21-4304db5af1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:38.976959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2170-e5d5-4062-9c21-4304db5af1b6 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:38.978680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 683/1369] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:08:38.984028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697fd74-943d-40f2-84a6-3f5098a3e1ba None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:38.984318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697fd74-943d-40f2-84a6-3f5098a3e1ba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:38.984593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697fd74-943d-40f2-84a6-3f5098a3e1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:39.019233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:39.058802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7697fd74-943d-40f2-84a6-3f5098a3e1ba None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:39.060042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7697fd74-943d-40f2-84a6-3f5098a3e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:39.162860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 687/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:39.743880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223163d-752c-42d6-a179-be72b66e06bb None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:39.743880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223163d-752c-42d6-a179-be72b66e06bb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:39.743880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223163d-752c-42d6-a179-be72b66e06bb None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:39.746344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 684/1371] 10.222.0.60 () {54 vars in 964 bytes} [Wed Aug 17 16:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:39.749755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952c83b-f016-461e-8969-1f2f6d88e6ce None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:39.750257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952c83b-f016-461e-8969-1f2f6d88e6ce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:39.750411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952c83b-f016-461e-8969-1f2f6d88e6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:39.828021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3952c83b-f016-461e-8969-1f2f6d88e6ce None None] MFA Rules not processed for user `3474a82d27d04dcc9b9818608b00fb48`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:39.829235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3952c83b-f016-461e-8969-1f2f6d88e6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:39.878038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:39.910146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 688/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Aug 17 16:08:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:39.917526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223163d-752c-42d6-a179-be72b66e06bb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:39.919088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f223163d-752c-42d6-a179-be72b66e06bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:40.029367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223163d-752c-42d6-a179-be72b66e06bb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:40.073932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:40.110793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccd7f8-26c4-4fa6-9776-f90ca120ab40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:40.111417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd7f8-26c4-4fa6-9776-f90ca120ab40 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:40.111701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd7f8-26c4-4fa6-9776-f90ca120ab40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:40.112000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccd7f8-26c4-4fa6-9776-f90ca120ab40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:40.113621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c5ccd7f8-26c4-4fa6-9776-f90ca120ab40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:40.232380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccd7f8-26c4-4fa6-9776-f90ca120ab40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:40.233688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccd7f8-26c4-4fa6-9776-f90ca120ab40 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:40.253348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 685/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:40.313309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992cf0-790d-45b8-8632-54cb46d3358d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:40.313619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992cf0-790d-45b8-8632-54cb46d3358d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:40.313866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70992cf0-790d-45b8-8632-54cb46d3358d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:40.315360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 689/1374] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:40.321478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccab4-f7f7-4e1f-9f47-de70c993fe08 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:40.321644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccab4-f7f7-4e1f-9f47-de70c993fe08 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:40.322138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaccab4-f7f7-4e1f-9f47-de70c993fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:40.422923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ffaccab4-f7f7-4e1f-9f47-de70c993fe08 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:40.424615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ffaccab4-f7f7-4e1f-9f47-de70c993fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:40.452066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:40.536291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 686/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:40.824087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992cf0-790d-45b8-8632-54cb46d3358d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:40.825617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-70992cf0-790d-45b8-8632-54cb46d3358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:40.981389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70992cf0-790d-45b8-8632-54cb46d3358d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:41.033005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:41.097908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c1784-af96-4cb8-8642-f33296029c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:41.098437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1784-af96-4cb8-8642-f33296029c3d service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:41.098719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1784-af96-4cb8-8642-f33296029c3d service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:41.098997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1784-af96-4cb8-8642-f33296029c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:41.101708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-231c1784-af96-4cb8-8642-f33296029c3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:41.192849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c1784-af96-4cb8-8642-f33296029c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:41.194625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c1784-af96-4cb8-8642-f33296029c3d service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:41.213277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 690/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:43.168822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8438-76d0-4b1d-98e5-05ebe4412e0a None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:43.169329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8438-76d0-4b1d-98e5-05ebe4412e0a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:43.169423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b8438-76d0-4b1d-98e5-05ebe4412e0a None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:43.170720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 687/1377] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:43.175827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e2c40-3fb8-4d90-bdb6-58ab937083a1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:43.176271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e2c40-3fb8-4d90-bdb6-58ab937083a1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:43.176403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e2c40-3fb8-4d90-bdb6-58ab937083a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:43.246008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e72e2c40-3fb8-4d90-bdb6-58ab937083a1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:43.247608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e72e2c40-3fb8-4d90-bdb6-58ab937083a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:43.254356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:43.373954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 691/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:43.662555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b8438-76d0-4b1d-98e5-05ebe4412e0a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:43.664393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2c7b8438-76d0-4b1d-98e5-05ebe4412e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:43.868033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b8438-76d0-4b1d-98e5-05ebe4412e0a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:43.873306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:44.007893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e733541-22bd-414d-8df2-bbbd8e01eb4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:44.008515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e733541-22bd-414d-8df2-bbbd8e01eb4f service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:44.008797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e733541-22bd-414d-8df2-bbbd8e01eb4f service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:44.009071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e733541-22bd-414d-8df2-bbbd8e01eb4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:44.010696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6e733541-22bd-414d-8df2-bbbd8e01eb4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:44.109337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e733541-22bd-414d-8df2-bbbd8e01eb4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:44.111114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e733541-22bd-414d-8df2-bbbd8e01eb4f service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:44.130938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 688/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:46.114633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9350ab-68b9-44bd-be8f-53b8b0b02ba3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:46.115128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9350ab-68b9-44bd-be8f-53b8b0b02ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:46.115207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9350ab-68b9-44bd-be8f-53b8b0b02ba3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:46.119855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 692/1380] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:46.122387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6809ba-6ab2-4c49-8e7c-d4848bd7c182 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:46.122826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6809ba-6ab2-4c49-8e7c-d4848bd7c182 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:46.123264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6809ba-6ab2-4c49-8e7c-d4848bd7c182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:46.136817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:46.203447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-0f6809ba-6ab2-4c49-8e7c-d4848bd7c182 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:46.204775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0f6809ba-6ab2-4c49-8e7c-d4848bd7c182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:46.319886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 689/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:46.611440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9350ab-68b9-44bd-be8f-53b8b0b02ba3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:46.613084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3c9350ab-68b9-44bd-be8f-53b8b0b02ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:46.774255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:46.786294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9350ab-68b9-44bd-be8f-53b8b0b02ba3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:46.924541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d1f26-5ee3-48a6-ba32-531733a38416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:46.925183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d1f26-5ee3-48a6-ba32-531733a38416 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:46.925461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d1f26-5ee3-48a6-ba32-531733a38416 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:46.925728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d1f26-5ee3-48a6-ba32-531733a38416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:46.927305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-900d1f26-5ee3-48a6-ba32-531733a38416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:47.023991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d1f26-5ee3-48a6-ba32-531733a38416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:47.025638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d1f26-5ee3-48a6-ba32-531733a38416 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:47.036716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:47.047977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 693/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:08:49.201659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea5b3e-6029-43e0-82da-895a1bb90321 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:49.202245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea5b3e-6029-43e0-82da-895a1bb90321 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:49.202245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea5b3e-6029-43e0-82da-895a1bb90321 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:49.203553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 690/1383] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:49.210907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bddfc-07ef-45c9-be02-139c1c7db73d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:49.211375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bddfc-07ef-45c9-be02-139c1c7db73d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:49.211654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bddfc-07ef-45c9-be02-139c1c7db73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:49.311871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f61bddfc-07ef-45c9-be02-139c1c7db73d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:49.313195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f61bddfc-07ef-45c9-be02-139c1c7db73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:49.419958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 694/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:49.710079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea5b3e-6029-43e0-82da-895a1bb90321 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:49.711946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-32ea5b3e-6029-43e0-82da-895a1bb90321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:49.819172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:49.898025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea5b3e-6029-43e0-82da-895a1bb90321 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:50.021912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da728fd9-393b-4a0c-be0d-f91b04e3015f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:50.022563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da728fd9-393b-4a0c-be0d-f91b04e3015f service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:50.022849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da728fd9-393b-4a0c-be0d-f91b04e3015f service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:50.023121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da728fd9-393b-4a0c-be0d-f91b04e3015f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:50.024801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-da728fd9-393b-4a0c-be0d-f91b04e3015f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:50.077164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:50.121735 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da728fd9-393b-4a0c-be0d-f91b04e3015f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:50.123380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da728fd9-393b-4a0c-be0d-f91b04e3015f service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:50.141763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 691/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:52.213894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31d39-b698-4905-8ee2-319e801844b8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:52.214511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31d39-b698-4905-8ee2-319e801844b8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:52.214651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31d39-b698-4905-8ee2-319e801844b8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:52.216477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 695/1386] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:52.223347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9e30-46c7-4dd4-b952-2dce6cfe4b1a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:52.223973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9e30-46c7-4dd4-b952-2dce6cfe4b1a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:52.224083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e9e30-46c7-4dd4-b952-2dce6cfe4b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:52.309710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b09e9e30-46c7-4dd4-b952-2dce6cfe4b1a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:52.311003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b09e9e30-46c7-4dd4-b952-2dce6cfe4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:52.416024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 692/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:52.711021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31d39-b698-4905-8ee2-319e801844b8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:52.713036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-30e31d39-b698-4905-8ee2-319e801844b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:52.813373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:52.900129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31d39-b698-4905-8ee2-319e801844b8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:53.023405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd142122-b319-4586-ad20-6f48dee9c19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:53.023971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142122-b319-4586-ad20-6f48dee9c19d service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:53.024240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142122-b319-4586-ad20-6f48dee9c19d service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:53.024511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142122-b319-4586-ad20-6f48dee9c19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:53.026127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dd142122-b319-4586-ad20-6f48dee9c19d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:53.066553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:53.120477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd142122-b319-4586-ad20-6f48dee9c19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:53.122094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd142122-b319-4586-ad20-6f48dee9c19d service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:53.140429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 696/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:55.126698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedc5b-9ab3-4d04-8553-3c2763e0a1f6 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.127284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedc5b-9ab3-4d04-8553-3c2763e0a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.127284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eedc5b-9ab3-4d04-8553-3c2763e0a1f6 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.128759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 693/1389] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:55.134533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e8dd5-8e30-4fd2-ad08-6a14830b40e4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.134949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e8dd5-8e30-4fd2-ad08-6a14830b40e4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.135134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e8dd5-8e30-4fd2-ad08-6a14830b40e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.202993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-aa3e8dd5-8e30-4fd2-ad08-6a14830b40e4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:55.204225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-aa3e8dd5-8e30-4fd2-ad08-6a14830b40e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:55.302496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 697/1390] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:55.310891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab6a49-0d0d-4d7c-8e0a-4e98e45c34bf None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.311248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab6a49-0d0d-4d7c-8e0a-4e98e45c34bf None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.311592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab6a49-0d0d-4d7c-8e0a-4e98e45c34bf None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.313069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 694/1391] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:55.318142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156741d6-5e45-4f56-b794-bcf112452742 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.318432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156741d6-5e45-4f56-b794-bcf112452742 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.318707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156741d6-5e45-4f56-b794-bcf112452742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.334522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:55.386099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-156741d6-5e45-4f56-b794-bcf112452742 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:55.387228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-156741d6-5e45-4f56-b794-bcf112452742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:55.482537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 698/1392] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:55.595198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab6a49-0d0d-4d7c-8e0a-4e98e45c34bf None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:55.596816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e8ab6a49-0d0d-4d7c-8e0a-4e98e45c34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:55.630027 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:55.747395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab6a49-0d0d-4d7c-8e0a-4e98e45c34bf None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:55.790222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbde20-a3bb-4ce2-a4cb-1f80493054d2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.790515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbde20-a3bb-4ce2-a4cb-1f80493054d2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.790799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbde20-a3bb-4ce2-a4cb-1f80493054d2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.792314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 699/1393] 10.222.0.60 () {54 vars in 967 bytes} [Wed Aug 17 16:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:08:55.796803 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2cb5-14ce-474e-8eda-895747141505 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.797094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2cb5-14ce-474e-8eda-895747141505 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.797375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2cb5-14ce-474e-8eda-895747141505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.857029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:55.870224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3962a7-4f41-440b-a36a-956620f61cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:55.870841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3962a7-4f41-440b-a36a-956620f61cb4 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.871117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3962a7-4f41-440b-a36a-956620f61cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.871383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3962a7-4f41-440b-a36a-956620f61cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.873038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4c3962a7-4f41-440b-a36a-956620f61cb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:55.879322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-84aa2cb5-14ce-474e-8eda-895747141505 None None] MFA Rules not processed for user `009c623055dc4defa2bd74a82c6a7e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:55.880548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-84aa2cb5-14ce-474e-8eda-895747141505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:55.915412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:55.957936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 700/1394] 10.222.0.60 () {58 vars in 1064 bytes} [Wed Aug 17 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:08:55.964560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3962a7-4f41-440b-a36a-956620f61cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:55.965440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa2cb5-14ce-474e-8eda-895747141505 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:55.966122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3962a7-4f41-440b-a36a-956620f61cb4 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:55.972799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa2cb5-14ce-474e-8eda-895747141505 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:55.985015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 695/1395] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:56.054231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f861-2fc2-4115-ad41-6879e56e190e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009c623055dc4defa2bd74a82c6a7e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:56.054858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f861-2fc2-4115-ad41-6879e56e190e service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:56.055140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f861-2fc2-4115-ad41-6879e56e190e service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:56.055418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f861-2fc2-4115-ad41-6879e56e190e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:56.057119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d615f861-2fc2-4115-ad41-6879e56e190e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:56.186685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:56.190721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f861-2fc2-4115-ad41-6879e56e190e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:56.192457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f861-2fc2-4115-ad41-6879e56e190e service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:56.212819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 701/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:08:56.951915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b3afd-7fcc-40df-b22c-12107bf0790d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:56.952418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b3afd-7fcc-40df-b22c-12107bf0790d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:56.952615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b3afd-7fcc-40df-b22c-12107bf0790d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.019945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-771b3afd-7fcc-40df-b22c-12107bf0790d None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:57.021146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-771b3afd-7fcc-40df-b22c-12107bf0790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:57.082033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:57.111582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 696/1397] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:08:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:57.155584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c968-ce25-4f99-b1fe-f8cbfb0e0e39 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.156042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c968-ce25-4f99-b1fe-f8cbfb0e0e39 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.156391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c968-ce25-4f99-b1fe-f8cbfb0e0e39 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.157956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 702/1398] 10.222.0.60 () {54 vars in 943 bytes} [Wed Aug 17 16:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:57.164105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1edc75-6cd1-4548-be05-6ca4f6097450 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.164469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1edc75-6cd1-4548-be05-6ca4f6097450 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.164820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1edc75-6cd1-4548-be05-6ca4f6097450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.243515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4e1edc75-6cd1-4548-be05-6ca4f6097450 None None] MFA Rules not processed for user `52a56e6519a04ac297ef8f2e1094157f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:57.244788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4e1edc75-6cd1-4548-be05-6ca4f6097450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:57.355090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 697/1399] 10.222.0.60 () {58 vars in 1040 bytes} [Wed Aug 17 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:57.364954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3c968-ce25-4f99-b1fe-f8cbfb0e0e39 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:57.367163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-27b3c968-ce25-4f99-b1fe-f8cbfb0e0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:57.505758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3c968-ce25-4f99-b1fe-f8cbfb0e0e39 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:57.578024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:57.615307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc892-5c3c-4209-8827-10fd7beef5cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:57.619945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc892-5c3c-4209-8827-10fd7beef5cb service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.620235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc892-5c3c-4209-8827-10fd7beef5cb service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.620507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc892-5c3c-4209-8827-10fd7beef5cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.622168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-053cc892-5c3c-4209-8827-10fd7beef5cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:57.707694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc892-5c3c-4209-8827-10fd7beef5cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:57.709338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc892-5c3c-4209-8827-10fd7beef5cb service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:57.718599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 703/1400] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:08:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:08:57.968194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfdb70-ef20-43a1-a17e-1d5d1b1f21cc None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.968708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfdb70-ef20-43a1-a17e-1d5d1b1f21cc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.968708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfdb70-ef20-43a1-a17e-1d5d1b1f21cc None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.970012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 698/1401] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:57.975526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73af22-37da-4c8c-b8c3-0bddc37e74ca None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.975945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73af22-37da-4c8c-b8c3-0bddc37e74ca None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.976475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73af22-37da-4c8c-b8c3-0bddc37e74ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:58.054591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-eb73af22-37da-4c8c-b8c3-0bddc37e74ca None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:58.055857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eb73af22-37da-4c8c-b8c3-0bddc37e74ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:58.116844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:58.165388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 704/1402] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:58.458908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfdb70-ef20-43a1-a17e-1d5d1b1f21cc None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:58.460767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-00bfdb70-ef20-43a1-a17e-1d5d1b1f21cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:58.503853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:58.632993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfdb70-ef20-43a1-a17e-1d5d1b1f21cc None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:58.762900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:58.766163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a2a52-bbdc-44f9-a5f0-d948c8d26295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:58.767466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a2a52-bbdc-44f9-a5f0-d948c8d26295 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:58.767858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a2a52-bbdc-44f9-a5f0-d948c8d26295 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:58.768197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a2a52-bbdc-44f9-a5f0-d948c8d26295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:58.769913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-834a2a52-bbdc-44f9-a5f0-d948c8d26295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:58.874609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a2a52-bbdc-44f9-a5f0-d948c8d26295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:58.876438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a2a52-bbdc-44f9-a5f0-d948c8d26295 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:58.908561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 699/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:00.866199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f1cb-a014-4681-8976-5efa91c07fb2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:00.867270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f1cb-a014-4681-8976-5efa91c07fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:00.867787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f1cb-a014-4681-8976-5efa91c07fb2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:00.870372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 705/1404] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:09:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:00.874874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa609-fa20-4a46-800d-00ddd2e8fd35 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:00.875317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa609-fa20-4a46-800d-00ddd2e8fd35 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:00.875475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefa609-fa20-4a46-800d-00ddd2e8fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:00.952196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-caefa609-fa20-4a46-800d-00ddd2e8fd35 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:00.953650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-caefa609-fa20-4a46-800d-00ddd2e8fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:01.039290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:01.076419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 700/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:01.409876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f1cb-a014-4681-8976-5efa91c07fb2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:01.411375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-75d2f1cb-a014-4681-8976-5efa91c07fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:01.600851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f1cb-a014-4681-8976-5efa91c07fb2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:01.655031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:01.748778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896edf64-175e-47e2-a594-e4dba402e93a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:01.749408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896edf64-175e-47e2-a594-e4dba402e93a service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:01.749697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896edf64-175e-47e2-a594-e4dba402e93a service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:01.750010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896edf64-175e-47e2-a594-e4dba402e93a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:01.751663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-896edf64-175e-47e2-a594-e4dba402e93a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:01.851295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896edf64-175e-47e2-a594-e4dba402e93a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:01.852877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896edf64-175e-47e2-a594-e4dba402e93a service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:01.872493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 706/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:09:03.853952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c77bb-9680-4559-b971-e82d87b36f82 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:03.854468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c77bb-9680-4559-b971-e82d87b36f82 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:03.854572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c77bb-9680-4559-b971-e82d87b36f82 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:03.855862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 701/1407] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:03.861039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9e351-a535-447b-9e7c-647aef741a65 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:03.861485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9e351-a535-447b-9e7c-647aef741a65 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:03.861586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9e351-a535-447b-9e7c-647aef741a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:03.929022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:03.931908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fae9e351-a535-447b-9e7c-647aef741a65 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:03.933999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fae9e351-a535-447b-9e7c-647aef741a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:04.049087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 707/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:04.338519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c77bb-9680-4559-b971-e82d87b36f82 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:04.340122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a27c77bb-9680-4559-b971-e82d87b36f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:04.499336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c77bb-9680-4559-b971-e82d87b36f82 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:04.562709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:04.629379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba2dc2-e543-4f48-a314-a7425db4eaf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:04.630114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2dc2-e543-4f48-a314-a7425db4eaf0 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:04.630465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2dc2-e543-4f48-a314-a7425db4eaf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:04.634573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba2dc2-e543-4f48-a314-a7425db4eaf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:04.634573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e0ba2dc2-e543-4f48-a314-a7425db4eaf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:04.735537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba2dc2-e543-4f48-a314-a7425db4eaf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:04.737339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba2dc2-e543-4f48-a314-a7425db4eaf0 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:04.758628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 702/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:14.047207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=44 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:14.753285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=73 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:20.530445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29057a-7e00-4e55-b2cc-65e03fa3a348 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:20.530980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29057a-7e00-4e55-b2cc-65e03fa3a348 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:20.530980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29057a-7e00-4e55-b2cc-65e03fa3a348 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:20.532324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 708/1410] 10.222.0.60 () {54 vars in 918 bytes} [Wed Aug 17 16:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:20.537961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a9bca-7f3b-42fd-9295-0a9d05705cba None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:20.538470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a9bca-7f3b-42fd-9295-0a9d05705cba None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:20.538581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a9bca-7f3b-42fd-9295-0a9d05705cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:20.614565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e99a9bca-7f3b-42fd-9295-0a9d05705cba None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:20.616568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e99a9bca-7f3b-42fd-9295-0a9d05705cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:20.722320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 703/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 17 16:09:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:20.736814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9dd17-bcb9-4c01-8712-36bcfa6ad7d2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:20.737094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9dd17-bcb9-4c01-8712-36bcfa6ad7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:20.737367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9dd17-bcb9-4c01-8712-36bcfa6ad7d2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:20.738711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 709/1412] 10.222.0.60 () {54 vars in 918 bytes} [Wed Aug 17 16:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:20.743684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2fed-41e0-4cfe-9c7d-e5b09755f510 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:20.743995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2fed-41e0-4cfe-9c7d-e5b09755f510 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:20.744270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc2fed-41e0-4cfe-9c7d-e5b09755f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:20.817048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:20.820718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-78fc2fed-41e0-4cfe-9c7d-e5b09755f510 None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:20.822483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-78fc2fed-41e0-4cfe-9c7d-e5b09755f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:20.940908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 704/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Aug 17 16:09:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:23.313701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72fc0-3c01-4c8b-81d0-22f5690804aa None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:23.314208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72fc0-3c01-4c8b-81d0-22f5690804aa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:23.314208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72fc0-3c01-4c8b-81d0-22f5690804aa None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.315514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:23.321004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cb0a-7170-465e-82f1-eeedf9b2134e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:23.321421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cb0a-7170-465e-82f1-eeedf9b2134e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:23.321569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cb0a-7170-465e-82f1-eeedf9b2134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:23.387976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d6a6cb0a-7170-465e-82f1-eeedf9b2134e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:23.389207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d6a6cb0a-7170-465e-82f1-eeedf9b2134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:23.443988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:23.486413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:23.791171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda72fc0-3c01-4c8b-81d0-22f5690804aa None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:23.792815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cda72fc0-3c01-4c8b-81d0-22f5690804aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:23.938779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda72fc0-3c01-4c8b-81d0-22f5690804aa None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:24.011060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:24.051551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2368-2f1b-45c7-8dcf-f372454d78cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:24.052133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2368-2f1b-45c7-8dcf-f372454d78cf service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:24.052407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2368-2f1b-45c7-8dcf-f372454d78cf service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:24.053192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2368-2f1b-45c7-8dcf-f372454d78cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:24.055198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a5aa2368-2f1b-45c7-8dcf-f372454d78cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:24.145419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2368-2f1b-45c7-8dcf-f372454d78cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:24.147047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2368-2f1b-45c7-8dcf-f372454d78cf service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:24.164921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 711/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:25.060562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9348-1428-4675-8bc4-711a6772422f None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.061127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9348-1428-4675-8bc4-711a6772422f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.061127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9348-1428-4675-8bc4-711a6772422f None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.062533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:25.067341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8f389-9661-4682-8ce0-ef8ae1b7e066 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.067746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8f389-9661-4682-8ce0-ef8ae1b7e066 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.067953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8f389-9661-4682-8ce0-ef8ae1b7e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.145339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ead8f389-9661-4682-8ce0-ef8ae1b7e066 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:25.147223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ead8f389-9661-4682-8ce0-ef8ae1b7e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:25.174161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:25.244389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:25.395463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c9348-1428-4675-8bc4-711a6772422f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:25.397720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-694c9348-1428-4675-8bc4-711a6772422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:25.544820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c9348-1428-4675-8bc4-711a6772422f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:25.584754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:25.658516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4029-d7c2-484c-8c7f-7b96abfb8e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:25.659047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4029-d7c2-484c-8c7f-7b96abfb8e29 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.659323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4029-d7c2-484c-8c7f-7b96abfb8e29 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.659591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4029-d7c2-484c-8c7f-7b96abfb8e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.661213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-baff4029-d7c2-484c-8c7f-7b96abfb8e29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:25.750235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4029-d7c2-484c-8c7f-7b96abfb8e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:25.751885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4029-d7c2-484c-8c7f-7b96abfb8e29 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:25.770198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 707/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:26.658415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a886-5129-4917-961f-3555e21f8b80 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:26.658969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a886-5129-4917-961f-3555e21f8b80 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:26.658969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83a886-5129-4917-961f-3555e21f8b80 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:26.660342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:26.665752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4610bd-bcd6-4b8c-b987-49b4975a93f7 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:26.666143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4610bd-bcd6-4b8c-b987-49b4975a93f7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:26.666416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4610bd-bcd6-4b8c-b987-49b4975a93f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:26.720677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:26.744088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2a4610bd-bcd6-4b8c-b987-49b4975a93f7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:26.745296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2a4610bd-bcd6-4b8c-b987-49b4975a93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:26.843559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:09:27.001483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83a886-5129-4917-961f-3555e21f8b80 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:27.002924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3b83a886-5129-4917-961f-3555e21f8b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:27.151166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83a886-5129-4917-961f-3555e21f8b80 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:27.163674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:27.264963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28562d6-3519-40b7-9a79-985bce162bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:27.265517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28562d6-3519-40b7-9a79-985bce162bd6 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:27.265778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28562d6-3519-40b7-9a79-985bce162bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:27.266048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28562d6-3519-40b7-9a79-985bce162bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:27.267646 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d28562d6-3519-40b7-9a79-985bce162bd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:27.356508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28562d6-3519-40b7-9a79-985bce162bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:27.358111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28562d6-3519-40b7-9a79-985bce162bd6 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:27.376580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 714/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:28.243369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb10c-5986-478d-a0fb-1635198830a6 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:28.243982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb10c-5986-478d-a0fb-1635198830a6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:28.243982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb10c-5986-478d-a0fb-1635198830a6 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:28.245300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:28.250174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b6e3e-13d3-4625-b536-675d4848fcf6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:28.250606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b6e3e-13d3-4625-b536-675d4848fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:28.250815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b6e3e-13d3-4625-b536-675d4848fcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:28.270989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:28.329834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-879b6e3e-13d3-4625-b536-675d4848fcf6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:28.331036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-879b6e3e-13d3-4625-b536-675d4848fcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:28.428624 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:28.582358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb10c-5986-478d-a0fb-1635198830a6 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:28.583888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d16cb10c-5986-478d-a0fb-1635198830a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:28.695251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:28.732057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb10c-5986-478d-a0fb-1635198830a6 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:28.845747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d2bdb-497d-499c-8663-67a5121a1762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:28.846378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2bdb-497d-499c-8663-67a5121a1762 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:28.846641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2bdb-497d-499c-8663-67a5121a1762 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:28.846914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d2bdb-497d-499c-8663-67a5121a1762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:28.848571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7c3d2bdb-497d-499c-8663-67a5121a1762 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:28.925219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:28.939700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d2bdb-497d-499c-8663-67a5121a1762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:28.941351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d2bdb-497d-499c-8663-67a5121a1762 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:28.959375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 710/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:29.826304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e202b-665b-4e51-a8d4-5d2f92591708 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:29.826870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e202b-665b-4e51-a8d4-5d2f92591708 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:29.826974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e202b-665b-4e51-a8d4-5d2f92591708 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:29.828323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:29.833491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f22325-8ac1-4d77-968e-c5b16cff8310 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:29.834601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f22325-8ac1-4d77-968e-c5b16cff8310 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:29.834747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f22325-8ac1-4d77-968e-c5b16cff8310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:29.910900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-47f22325-8ac1-4d77-968e-c5b16cff8310 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:29.912238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-47f22325-8ac1-4d77-968e-c5b16cff8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:30.009858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:30.158904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e202b-665b-4e51-a8d4-5d2f92591708 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:30.160496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d81e202b-665b-4e51-a8d4-5d2f92591708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:30.245270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:30.307656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e202b-665b-4e51-a8d4-5d2f92591708 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:30.418809 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6e065-5feb-42b7-8758-4722f226d601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:30.419344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e065-5feb-42b7-8758-4722f226d601 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:30.419622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e065-5feb-42b7-8758-4722f226d601 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:30.419925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e065-5feb-42b7-8758-4722f226d601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:30.421525 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a1b6e065-5feb-42b7-8758-4722f226d601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:30.473536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:30.516109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6e065-5feb-42b7-8758-4722f226d601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:30.517695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6e065-5feb-42b7-8758-4722f226d601 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:30.535352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 717/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:31.348784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f343d5-41db-4cfe-84e2-69f7b76b3e69 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.349347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f343d5-41db-4cfe-84e2-69f7b76b3e69 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.349347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f343d5-41db-4cfe-84e2-69f7b76b3e69 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.352050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:31.356916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f50-0e02-426e-a76a-f78a0a6fc890 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.357376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f50-0e02-426e-a76a-f78a0a6fc890 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.357495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601f50-0e02-426e-a76a-f78a0a6fc890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.435267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2c601f50-0e02-426e-a76a-f78a0a6fc890 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:31.436565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2c601f50-0e02-426e-a76a-f78a0a6fc890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:31.539347 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:31.689476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f343d5-41db-4cfe-84e2-69f7b76b3e69 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:31.691063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b4f343d5-41db-4cfe-84e2-69f7b76b3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:31.742355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:31.841957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f343d5-41db-4cfe-84e2-69f7b76b3e69 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:31.954751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df00bf-482f-4c44-bff1-93f4607dc2bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:31.955375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df00bf-482f-4c44-bff1-93f4607dc2bd service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:31.955662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df00bf-482f-4c44-bff1-93f4607dc2bd service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:31.955986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df00bf-482f-4c44-bff1-93f4607dc2bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:31.957675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-56df00bf-482f-4c44-bff1-93f4607dc2bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:31.965045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:32.047694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df00bf-482f-4c44-bff1-93f4607dc2bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:32.049350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df00bf-482f-4c44-bff1-93f4607dc2bd service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:32.067655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 713/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:32.872550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde654-2390-4431-8f42-d934ad2f5e15 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:32.873011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde654-2390-4431-8f42-d934ad2f5e15 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:32.873117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bde654-2390-4431-8f42-d934ad2f5e15 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:32.874440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:32.879418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2ee69-5ad5-4e18-9bf7-7feb1a221419 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:32.879873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2ee69-5ad5-4e18-9bf7-7feb1a221419 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:32.879992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2ee69-5ad5-4e18-9bf7-7feb1a221419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:32.955061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c3e2ee69-5ad5-4e18-9bf7-7feb1a221419 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:32.956312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c3e2ee69-5ad5-4e18-9bf7-7feb1a221419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:33.024041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:33.055546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:33.208027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde654-2390-4431-8f42-d934ad2f5e15 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:33.210531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-71bde654-2390-4431-8f42-d934ad2f5e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:33.228824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:33.357177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bde654-2390-4431-8f42-d934ad2f5e15 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:33.446542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:33.472638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea8d71-24e5-4c63-8044-138fd0260688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:33.473241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea8d71-24e5-4c63-8044-138fd0260688 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:33.473519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea8d71-24e5-4c63-8044-138fd0260688 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:33.473790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea8d71-24e5-4c63-8044-138fd0260688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:33.476538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b2ea8d71-24e5-4c63-8044-138fd0260688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:33.565300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea8d71-24e5-4c63-8044-138fd0260688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:33.566811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea8d71-24e5-4c63-8044-138fd0260688 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:33.585667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 720/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:34.409366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528642f-9c74-4e28-a025-e51413f708fa None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:34.409902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528642f-9c74-4e28-a025-e51413f708fa None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:34.409902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528642f-9c74-4e28-a025-e51413f708fa None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:34.411280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:34.416155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d87947-b295-4997-aff5-474d634d7ceb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:34.416562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d87947-b295-4997-aff5-474d634d7ceb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:34.416710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d87947-b295-4997-aff5-474d634d7ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:34.494016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-32d87947-b295-4997-aff5-474d634d7ceb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:34.495225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-32d87947-b295-4997-aff5-474d634d7ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:34.536778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:34.591665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:34.746056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528642f-9c74-4e28-a025-e51413f708fa None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:34.747614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f528642f-9c74-4e28-a025-e51413f708fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:34.893802 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528642f-9c74-4e28-a025-e51413f708fa None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:34.947470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:35.007204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ee081-e5c1-4f6b-9fad-7985e476a74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:35.007849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee081-e5c1-4f6b-9fad-7985e476a74b service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.008135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee081-e5c1-4f6b-9fad-7985e476a74b service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.008410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee081-e5c1-4f6b-9fad-7985e476a74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.010026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ba0ee081-e5c1-4f6b-9fad-7985e476a74b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:35.099180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ee081-e5c1-4f6b-9fad-7985e476a74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:35.101973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ee081-e5c1-4f6b-9fad-7985e476a74b service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:35.119762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 716/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:35.928841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d645-a2bd-4136-ae9f-99b749847f7a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.929375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d645-a2bd-4136-ae9f-99b749847f7a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.929375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961d645-a2bd-4136-ae9f-99b749847f7a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:35.930663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:35.935779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8954-c4d8-4701-b7e2-82285eabed3a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:35.936177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8954-c4d8-4701-b7e2-82285eabed3a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:35.936377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8954-c4d8-4701-b7e2-82285eabed3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:36.011827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-eebb8954-c4d8-4701-b7e2-82285eabed3a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:36.013053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-eebb8954-c4d8-4701-b7e2-82285eabed3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:36.015074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:36.110360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:36.267098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961d645-a2bd-4136-ae9f-99b749847f7a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:36.268576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7961d645-a2bd-4136-ae9f-99b749847f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:36.418562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961d645-a2bd-4136-ae9f-99b749847f7a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:36.447828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:36.548795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589fa75-df19-46f6-b6d2-3783f2f9e9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:36.549410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589fa75-df19-46f6-b6d2-3783f2f9e9dd service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:36.549689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589fa75-df19-46f6-b6d2-3783f2f9e9dd service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:36.549964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589fa75-df19-46f6-b6d2-3783f2f9e9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:36.551570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e589fa75-df19-46f6-b6d2-3783f2f9e9dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:36.644543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589fa75-df19-46f6-b6d2-3783f2f9e9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:36.646153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589fa75-df19-46f6-b6d2-3783f2f9e9dd service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:36.667668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 723/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:38.492109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05688e-ac52-49f9-a3a9-8d8b39755f0b None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:38.492665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05688e-ac52-49f9-a3a9-8d8b39755f0b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:38.492665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05688e-ac52-49f9-a3a9-8d8b39755f0b None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:38.494013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:38.499554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc489f-a962-4b97-a862-ea651bfd8e19 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:38.500005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc489f-a962-4b97-a862-ea651bfd8e19 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:38.500156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc489f-a962-4b97-a862-ea651bfd8e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:38.542177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:38.567059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a4bc489f-a962-4b97-a862-ea651bfd8e19 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:38.568822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a4bc489f-a962-4b97-a862-ea651bfd8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:38.666591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:38.949290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05688e-ac52-49f9-a3a9-8d8b39755f0b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:38.950850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7a05688e-ac52-49f9-a3a9-8d8b39755f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:39.057072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05688e-ac52-49f9-a3a9-8d8b39755f0b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:39.089550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:39.131709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7992553-a313-40b3-a586-41a5627a230f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:39.132352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7992553-a313-40b3-a586-41a5627a230f service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:39.132635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7992553-a313-40b3-a586-41a5627a230f service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:39.132910 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7992553-a313-40b3-a586-41a5627a230f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:39.134549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b7992553-a313-40b3-a586-41a5627a230f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:39.244071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7992553-a313-40b3-a586-41a5627a230f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:39.245560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7992553-a313-40b3-a586-41a5627a230f service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:39.263222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 719/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:41.329052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920d8c6-3558-4915-8f14-15e8a61cd511 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:41.329580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920d8c6-3558-4915-8f14-15e8a61cd511 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:41.329580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920d8c6-3558-4915-8f14-15e8a61cd511 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:41.330942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:41.336294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2118f-66dd-494d-8432-c42ac100d9a4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:41.336693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2118f-66dd-494d-8432-c42ac100d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:41.336848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2118f-66dd-494d-8432-c42ac100d9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:41.406588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7fb2118f-66dd-494d-8432-c42ac100d9a4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:41.407840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7fb2118f-66dd-494d-8432-c42ac100d9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:41.420731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:41.511181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:41.800433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920d8c6-3558-4915-8f14-15e8a61cd511 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:41.802004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7920d8c6-3558-4915-8f14-15e8a61cd511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:41.908965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920d8c6-3558-4915-8f14-15e8a61cd511 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:41.921727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:41.984009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbbc36-773a-4870-b863-66498f7a88b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:41.984618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbc36-773a-4870-b863-66498f7a88b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:41.984896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbc36-773a-4870-b863-66498f7a88b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:41.985167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbbc36-773a-4870-b863-66498f7a88b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:41.986765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a2cbbc36-773a-4870-b863-66498f7a88b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:42.094599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbbc36-773a-4870-b863-66498f7a88b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:42.095984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbbc36-773a-4870-b863-66498f7a88b3 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:42.114341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 726/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:44.394965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d905f-12bb-47e4-9f7f-80e704ba9831 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:44.395507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d905f-12bb-47e4-9f7f-80e704ba9831 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:44.395507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d905f-12bb-47e4-9f7f-80e704ba9831 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:44.396893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:44.402322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac148-64db-4890-8a76-0531d57e4660 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:44.402726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac148-64db-4890-8a76-0531d57e4660 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:44.402873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eac148-64db-4890-8a76-0531d57e4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:44.451879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:44.469416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a6eac148-64db-4890-8a76-0531d57e4660 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:44.470626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a6eac148-64db-4890-8a76-0531d57e4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:44.568465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:44.855615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d905f-12bb-47e4-9f7f-80e704ba9831 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:44.857198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-fe6d905f-12bb-47e4-9f7f-80e704ba9831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:44.961043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d905f-12bb-47e4-9f7f-80e704ba9831 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:45.001071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:45.035402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86e718-2938-421f-bcfd-ec59d2ddacf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:45.036030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e718-2938-421f-bcfd-ec59d2ddacf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:45.036309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e718-2938-421f-bcfd-ec59d2ddacf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:45.036581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86e718-2938-421f-bcfd-ec59d2ddacf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:45.038235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7a86e718-2938-421f-bcfd-ec59d2ddacf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:45.146794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86e718-2938-421f-bcfd-ec59d2ddacf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:45.148283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86e718-2938-421f-bcfd-ec59d2ddacf8 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:45.165995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 722/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:47.191618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba278e5-6936-4066-8869-d08271ee533a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:47.192188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba278e5-6936-4066-8869-d08271ee533a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:47.192284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba278e5-6936-4066-8869-d08271ee533a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:47.194257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:47.200598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eed25f-3622-4e5d-83ed-f382675cfa07 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:47.201069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eed25f-3622-4e5d-83ed-f382675cfa07 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:47.201166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eed25f-3622-4e5d-83ed-f382675cfa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:47.266719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-79eed25f-3622-4e5d-83ed-f382675cfa07 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:47.267958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-79eed25f-3622-4e5d-83ed-f382675cfa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:47.288589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:47.366060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:47.649415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba278e5-6936-4066-8869-d08271ee533a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:47.650993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5ba278e5-6936-4066-8869-d08271ee533a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:47.755389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba278e5-6936-4066-8869-d08271ee533a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:47.775247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:47.830524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cd7de-7616-430f-9e98-da7f7725fc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:47.831135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd7de-7616-430f-9e98-da7f7725fc64 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:47.831411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd7de-7616-430f-9e98-da7f7725fc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:47.831682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd7de-7616-430f-9e98-da7f7725fc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:47.834532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7f6cd7de-7616-430f-9e98-da7f7725fc64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:47.947925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cd7de-7616-430f-9e98-da7f7725fc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:47.949303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cd7de-7616-430f-9e98-da7f7725fc64 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:47.967551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 729/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:49.948311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaae2c-f72b-4263-b3c6-0242562f5cac None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:49.948834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaae2c-f72b-4263-b3c6-0242562f5cac None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:49.948834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaae2c-f72b-4263-b3c6-0242562f5cac None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:49.950212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:49.955288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b667e3c-795f-4656-8c9a-a2bfc9f9d1bf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:49.955708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b667e3c-795f-4656-8c9a-a2bfc9f9d1bf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:49.955847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b667e3c-795f-4656-8c9a-a2bfc9f9d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:50.020277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:50.024030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9b667e3c-795f-4656-8c9a-a2bfc9f9d1bf None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:50.025761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9b667e3c-795f-4656-8c9a-a2bfc9f9d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:50.122091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:50.407841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaae2c-f72b-4263-b3c6-0242562f5cac None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:50.409410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-72aaae2c-f72b-4263-b3c6-0242562f5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:50.514716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaae2c-f72b-4263-b3c6-0242562f5cac None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:50.564023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:50.589186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0206b-7da7-45a4-a29c-2a4dece220b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:50.589800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0206b-7da7-45a4-a29c-2a4dece220b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:50.590079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0206b-7da7-45a4-a29c-2a4dece220b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:50.590348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0206b-7da7-45a4-a29c-2a4dece220b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:50.592006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a8a0206b-7da7-45a4-a29c-2a4dece220b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:50.703889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0206b-7da7-45a4-a29c-2a4dece220b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:50.705267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0206b-7da7-45a4-a29c-2a4dece220b0 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:50.723558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 725/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:52.758116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1d27-201b-4354-aaea-e92b34c6edae None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:52.758661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1d27-201b-4354-aaea-e92b34c6edae None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:52.758661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee1d27-201b-4354-aaea-e92b34c6edae None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:52.760027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:52.765461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbca7ed-3df1-46ac-bb0c-86b89eddf17d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:52.765948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbca7ed-3df1-46ac-bb0c-86b89eddf17d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:52.766086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbca7ed-3df1-46ac-bb0c-86b89eddf17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:52.835563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cdbca7ed-3df1-46ac-bb0c-86b89eddf17d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:52.836832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cdbca7ed-3df1-46ac-bb0c-86b89eddf17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:52.866992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:52.933784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:53.219518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1d27-201b-4354-aaea-e92b34c6edae None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:53.221171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-70ee1d27-201b-4354-aaea-e92b34c6edae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:53.325248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee1d27-201b-4354-aaea-e92b34c6edae None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:53.355414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:53.400300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2de73-bcff-4cc7-8489-d8d764dcb8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:53.400914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2de73-bcff-4cc7-8489-d8d764dcb8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:53.401196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2de73-bcff-4cc7-8489-d8d764dcb8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:53.401469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2de73-bcff-4cc7-8489-d8d764dcb8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:53.403100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8cc2de73-bcff-4cc7-8489-d8d764dcb8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:53.510914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2de73-bcff-4cc7-8489-d8d764dcb8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:53.512385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2de73-bcff-4cc7-8489-d8d764dcb8d0 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:53.530459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 732/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:55.484340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65646541-f4ab-4877-a201-8d4acb769196 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:55.484930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65646541-f4ab-4877-a201-8d4acb769196 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:55.484930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65646541-f4ab-4877-a201-8d4acb769196 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:55.486249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:55.491737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee52b5-ba4a-44ac-8c81-7abaf49a61ca None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:55.492190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee52b5-ba4a-44ac-8c81-7abaf49a61ca None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:55.492329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee52b5-ba4a-44ac-8c81-7abaf49a61ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:55.558499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c3ee52b5-ba4a-44ac-8c81-7abaf49a61ca None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:55.559719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c3ee52b5-ba4a-44ac-8c81-7abaf49a61ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:55.568341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:55.657480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:09:55.940360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65646541-f4ab-4877-a201-8d4acb769196 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:55.941913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-65646541-f4ab-4877-a201-8d4acb769196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:56.047004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65646541-f4ab-4877-a201-8d4acb769196 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:56.105499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:56.124783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da5f56-837a-4ae7-8467-419f282b268f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:56.125391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da5f56-837a-4ae7-8467-419f282b268f service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:56.125671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da5f56-837a-4ae7-8467-419f282b268f service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:56.125940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da5f56-837a-4ae7-8467-419f282b268f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:56.127553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-89da5f56-837a-4ae7-8467-419f282b268f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:56.236125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da5f56-837a-4ae7-8467-419f282b268f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:56.237546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da5f56-837a-4ae7-8467-419f282b268f service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:56.257409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 728/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:58.203923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b39be-91ac-4a6d-9a11-aff9eb5ff8ec None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:58.204521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b39be-91ac-4a6d-9a11-aff9eb5ff8ec None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:58.204521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b39be-91ac-4a6d-9a11-aff9eb5ff8ec None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:58.205857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:58.211264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042f98-07c8-4597-9305-c078772e929d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:58.211694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042f98-07c8-4597-9305-c078772e929d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:58.211869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1042f98-07c8-4597-9305-c078772e929d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:58.277328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c1042f98-07c8-4597-9305-c078772e929d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:58.278548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c1042f98-07c8-4597-9305-c078772e929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:58.319123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:58.378224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:58.666319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b39be-91ac-4a6d-9a11-aff9eb5ff8ec None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:58.667890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-566b39be-91ac-4a6d-9a11-aff9eb5ff8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:58.770129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b39be-91ac-4a6d-9a11-aff9eb5ff8ec None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:58.808404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:58.854398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835d39f-09ce-4ddf-986a-986cb8a792e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:58.855014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d39f-09ce-4ddf-986a-986cb8a792e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:58.855296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d39f-09ce-4ddf-986a-986cb8a792e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:58.855574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835d39f-09ce-4ddf-986a-986cb8a792e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:58.857233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5835d39f-09ce-4ddf-986a-986cb8a792e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:58.977316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835d39f-09ce-4ddf-986a-986cb8a792e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:58.978697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835d39f-09ce-4ddf-986a-986cb8a792e5 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:58.996398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 735/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:00.943857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbe36e-8dfb-406d-a120-ece1d19dcf83 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:00.944431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbe36e-8dfb-406d-a120-ece1d19dcf83 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:00.944431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbe36e-8dfb-406d-a120-ece1d19dcf83 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:00.945769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:00.951016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514aa5-c704-46d4-b616-1b1c53794b77 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:00.951443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514aa5-c704-46d4-b616-1b1c53794b77 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:00.951552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08514aa5-c704-46d4-b616-1b1c53794b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:01.016781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-08514aa5-c704-46d4-b616-1b1c53794b77 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:01.018085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-08514aa5-c704-46d4-b616-1b1c53794b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:01.035695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:01.116187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:01.402733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbe36e-8dfb-406d-a120-ece1d19dcf83 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:01.404329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d9bbe36e-8dfb-406d-a120-ece1d19dcf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:01.508435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbe36e-8dfb-406d-a120-ece1d19dcf83 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:01.574789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:01.582012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3fb95-399a-4065-addf-b88e5d44f2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:01.582628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fb95-399a-4065-addf-b88e5d44f2ad service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:01.582907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fb95-399a-4065-addf-b88e5d44f2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:01.583818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fb95-399a-4065-addf-b88e5d44f2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:01.585479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5cb3fb95-399a-4065-addf-b88e5d44f2ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:01.694625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3fb95-399a-4065-addf-b88e5d44f2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:01.696005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3fb95-399a-4065-addf-b88e5d44f2ad service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:01.714351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 731/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:03.660977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea3e7-09c6-4a31-8272-14f69ac041ec None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:03.661489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea3e7-09c6-4a31-8272-14f69ac041ec None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:03.661601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea3e7-09c6-4a31-8272-14f69ac041ec None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:03.662933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:03.668411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce061-4aac-4b6d-9084-34bb8d50d46c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:03.668837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce061-4aac-4b6d-9084-34bb8d50d46c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:03.668962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce061-4aac-4b6d-9084-34bb8d50d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:03.737015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7c0ce061-4aac-4b6d-9084-34bb8d50d46c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:03.738228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7c0ce061-4aac-4b6d-9084-34bb8d50d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:03.787777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:03.838213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:04.122484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea3e7-09c6-4a31-8272-14f69ac041ec None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:04.124067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-807ea3e7-09c6-4a31-8272-14f69ac041ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:04.228532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea3e7-09c6-4a31-8272-14f69ac041ec None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:04.276017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:04.303508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101fc39-db6a-43df-a7f0-d6e9533a6caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:04.304163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101fc39-db6a-43df-a7f0-d6e9533a6caf service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:04.304446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101fc39-db6a-43df-a7f0-d6e9533a6caf service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:04.304718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101fc39-db6a-43df-a7f0-d6e9533a6caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:04.306367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0101fc39-db6a-43df-a7f0-d6e9533a6caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:04.416491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101fc39-db6a-43df-a7f0-d6e9533a6caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:04.417863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101fc39-db6a-43df-a7f0-d6e9533a6caf service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:04.435551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 738/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:13.836498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=22 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:14.433364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=66 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:24.020378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311ab5-826f-43eb-9cac-b91eaa463700 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:24.020929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311ab5-826f-43eb-9cac-b91eaa463700 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:24.020929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311ab5-826f-43eb-9cac-b91eaa463700 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:24.022291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 733/1471] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:24.027443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f92c7-1ec7-4b66-aaa9-2ae0c5537c90 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:24.027894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f92c7-1ec7-4b66-aaa9-2ae0c5537c90 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:24.028059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f92c7-1ec7-4b66-aaa9-2ae0c5537c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:24.212758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b31f92c7-1ec7-4b66-aaa9-2ae0c5537c90 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:24.213980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b31f92c7-1ec7-4b66-aaa9-2ae0c5537c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:24.310281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 739/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:24.607786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893b1b-8870-4917-92de-129328b5b32d None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:24.608096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893b1b-8870-4917-92de-129328b5b32d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:24.608377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1893b1b-8870-4917-92de-129328b5b32d None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:24.609737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 734/1473] 10.222.0.60 () {54 vars in 967 bytes} [Wed Aug 17 16:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:24.614666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bef07-888b-48f7-8d84-c64f17de0698 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:24.614953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bef07-888b-48f7-8d84-c64f17de0698 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:24.615227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bef07-888b-48f7-8d84-c64f17de0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:24.689927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a81bef07-888b-48f7-8d84-c64f17de0698 None None] MFA Rules not processed for user `009c623055dc4defa2bd74a82c6a7e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:24.691140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a81bef07-888b-48f7-8d84-c64f17de0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:24.712497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:24.767905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 740/1474] 10.222.0.60 () {58 vars in 1064 bytes} [Wed Aug 17 16:10:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:24.776172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893b1b-8870-4917-92de-129328b5b32d None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:24.777700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c1893b1b-8870-4917-92de-129328b5b32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:24.881880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1893b1b-8870-4917-92de-129328b5b32d None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:24.960881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd308406-85bf-4391-bc1e-f07947610468 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009c623055dc4defa2bd74a82c6a7e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:24.961497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd308406-85bf-4391-bc1e-f07947610468 service glance] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:24.961780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd308406-85bf-4391-bc1e-f07947610468 service glance] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:24.962055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd308406-85bf-4391-bc1e-f07947610468 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:24.963684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-fd308406-85bf-4391-bc1e-f07947610468 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:25.017343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:25.074260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd308406-85bf-4391-bc1e-f07947610468 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:25.075712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd308406-85bf-4391-bc1e-f07947610468 service glance] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:25.094762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 735/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:27.088349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d046d-bc80-409e-bcb8-bedf2aac5ff9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:27.088878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d046d-bc80-409e-bcb8-bedf2aac5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:27.088878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d046d-bc80-409e-bcb8-bedf2aac5ff9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:27.090170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 741/1476] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:27.095302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2f52a-0673-4ee7-8e28-eca76d1a54e4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:27.095698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2f52a-0673-4ee7-8e28-eca76d1a54e4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:27.095888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2f52a-0673-4ee7-8e28-eca76d1a54e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:27.161459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-3ed2f52a-0673-4ee7-8e28-eca76d1a54e4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:27.162661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3ed2f52a-0673-4ee7-8e28-eca76d1a54e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:27.259125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 736/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:27.530069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d046d-bc80-409e-bcb8-bedf2aac5ff9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:27.531606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ad7d046d-bc80-409e-bcb8-bedf2aac5ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:27.656508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d046d-bc80-409e-bcb8-bedf2aac5ff9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:27.706505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:27.753826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349de5e-0edc-4a3c-9897-b1e9681279b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:27.754476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349de5e-0edc-4a3c-9897-b1e9681279b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:27.754958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349de5e-0edc-4a3c-9897-b1e9681279b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:27.755304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349de5e-0edc-4a3c-9897-b1e9681279b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:27.755972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349de5e-0edc-4a3c-9897-b1e9681279b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:27.758031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-4349de5e-0edc-4a3c-9897-b1e9681279b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:10:27.758031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:10:27.758031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:10:27.759159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349de5e-0edc-4a3c-9897-b1e9681279b2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:27.778337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 742/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Aug 17 16:10:27 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:10:29.702592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378edb52-4e07-4ad2-9ce9-93a7cb7279a6 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:29.703202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378edb52-4e07-4ad2-9ce9-93a7cb7279a6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:29.703202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378edb52-4e07-4ad2-9ce9-93a7cb7279a6 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:29.704543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 737/1479] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:29.709855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25494aa5-12c9-4f8c-b89d-ee34783d3d87 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:29.710314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25494aa5-12c9-4f8c-b89d-ee34783d3d87 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:29.710428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25494aa5-12c9-4f8c-b89d-ee34783d3d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:29.777735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-25494aa5-12c9-4f8c-b89d-ee34783d3d87 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:29.778946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-25494aa5-12c9-4f8c-b89d-ee34783d3d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:29.877502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 743/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:10:30.167156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378edb52-4e07-4ad2-9ce9-93a7cb7279a6 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:30.168922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-378edb52-4e07-4ad2-9ce9-93a7cb7279a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:30.178926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:30.316005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378edb52-4e07-4ad2-9ce9-93a7cb7279a6 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:30.404811 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:30.438492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9fb4f-b2f4-4aff-8531-d68e9dcedf31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:30.439135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9fb4f-b2f4-4aff-8531-d68e9dcedf31 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:30.439415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9fb4f-b2f4-4aff-8531-d68e9dcedf31 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:30.439688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9fb4f-b2f4-4aff-8531-d68e9dcedf31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:30.441350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-11b9fb4f-b2f4-4aff-8531-d68e9dcedf31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:30.531545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9fb4f-b2f4-4aff-8531-d68e9dcedf31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:30.533189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9fb4f-b2f4-4aff-8531-d68e9dcedf31 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:30.550838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 738/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:32.667461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f18cb-b7e6-4468-b218-d2ac0f6563ad None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:32.668058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f18cb-b7e6-4468-b218-d2ac0f6563ad None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:32.668058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f18cb-b7e6-4468-b218-d2ac0f6563ad None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:32.669396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 744/1482] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:32.674663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc8755-d310-419a-a8d9-5a7370ab250c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:32.675069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc8755-d310-419a-a8d9-5a7370ab250c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:32.675210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc8755-d310-419a-a8d9-5a7370ab250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:32.743231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b7fc8755-d310-419a-a8d9-5a7370ab250c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:32.744516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b7fc8755-d310-419a-a8d9-5a7370ab250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:32.793441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:32.847232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 739/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:33.132694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f18cb-b7e6-4468-b218-d2ac0f6563ad None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:33.134252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-128f18cb-b7e6-4468-b218-d2ac0f6563ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:33.158071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:33.238192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f18cb-b7e6-4468-b218-d2ac0f6563ad None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:33.311690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8caf3-8a35-49fd-b059-3972def3bb38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:33.312333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8caf3-8a35-49fd-b059-3972def3bb38 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:33.312618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8caf3-8a35-49fd-b059-3972def3bb38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:33.312900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8caf3-8a35-49fd-b059-3972def3bb38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:33.314502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2de8caf3-8a35-49fd-b059-3972def3bb38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:33.390159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:33.425170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8caf3-8a35-49fd-b059-3972def3bb38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:33.426752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8caf3-8a35-49fd-b059-3972def3bb38 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:33.445419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 745/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:35.437809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973ed3-33b0-44e7-aa50-01d64204cf28 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:35.438338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973ed3-33b0-44e7-aa50-01d64204cf28 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:35.438338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89973ed3-33b0-44e7-aa50-01d64204cf28 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:35.439651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 740/1485] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:10:35.445717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c1c3-1126-4659-9cf1-83aa824fc00f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:35.446142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c1c3-1126-4659-9cf1-83aa824fc00f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:35.446296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c1c3-1126-4659-9cf1-83aa824fc00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:35.511106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d562c1c3-1126-4659-9cf1-83aa824fc00f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:35.512401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d562c1c3-1126-4659-9cf1-83aa824fc00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:35.607949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 746/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:35.900181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973ed3-33b0-44e7-aa50-01d64204cf28 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:35.901732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-89973ed3-33b0-44e7-aa50-01d64204cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:36.005795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89973ed3-33b0-44e7-aa50-01d64204cf28 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:36.077104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:36.078953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4966a-3ef9-4660-9e8d-fec62ba7d60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:36.079756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4966a-3ef9-4660-9e8d-fec62ba7d60c service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:36.080278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4966a-3ef9-4660-9e8d-fec62ba7d60c service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:36.080738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4966a-3ef9-4660-9e8d-fec62ba7d60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:36.082411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cbc4966a-3ef9-4660-9e8d-fec62ba7d60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:36.199817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4966a-3ef9-4660-9e8d-fec62ba7d60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:36.201269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4966a-3ef9-4660-9e8d-fec62ba7d60c service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:36.218842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 741/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:38.244824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dd4c2-0e3d-4fff-9b8f-ecf5370b9858 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:38.245392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dd4c2-0e3d-4fff-9b8f-ecf5370b9858 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:38.245392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dd4c2-0e3d-4fff-9b8f-ecf5370b9858 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:38.246703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 747/1488] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:38.252047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f627f-3900-4f53-ade2-381ba683ca97 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:38.252472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f627f-3900-4f53-ade2-381ba683ca97 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:38.252610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f627f-3900-4f53-ade2-381ba683ca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:38.319706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c57f627f-3900-4f53-ade2-381ba683ca97 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:38.320939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c57f627f-3900-4f53-ade2-381ba683ca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:38.373828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:38.418035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 742/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:38.708304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dd4c2-0e3d-4fff-9b8f-ecf5370b9858 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:38.709847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2d2dd4c2-0e3d-4fff-9b8f-ecf5370b9858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:38.746445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:38.816109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dd4c2-0e3d-4fff-9b8f-ecf5370b9858 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:38.889969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c0f0a-d49b-426a-83eb-e147d7dd1dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:38.890580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0f0a-d49b-426a-83eb-e147d7dd1dda service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:38.890860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0f0a-d49b-426a-83eb-e147d7dd1dda service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:38.891134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0f0a-d49b-426a-83eb-e147d7dd1dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:38.892769 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a54c0f0a-d49b-426a-83eb-e147d7dd1dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:38.974504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:39.004533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c0f0a-d49b-426a-83eb-e147d7dd1dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:39.006007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c0f0a-d49b-426a-83eb-e147d7dd1dda service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:39.025784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 748/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:41.147829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86c1e-11cc-425b-9b1d-18cd96ed4197 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:41.148356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86c1e-11cc-425b-9b1d-18cd96ed4197 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:41.148453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba86c1e-11cc-425b-9b1d-18cd96ed4197 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:41.149738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 743/1491] 10.222.0.60 () {54 vars in 927 bytes} [Wed Aug 17 16:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:41.154904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df523-ada2-4f89-aad0-997112358af3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:41.155295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df523-ada2-4f89-aad0-997112358af3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:41.155451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3df523-ada2-4f89-aad0-997112358af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:41.220697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1b3df523-ada2-4f89-aad0-997112358af3 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:41.221891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1b3df523-ada2-4f89-aad0-997112358af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:41.319880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 749/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:10:41.607485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86c1e-11cc-425b-9b1d-18cd96ed4197 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:41.609072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4ba86c1e-11cc-425b-9b1d-18cd96ed4197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:41.717498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba86c1e-11cc-425b-9b1d-18cd96ed4197 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:41.791007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c666-4582-4371-8c6d-ffa2a5321190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:41.791616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c666-4582-4371-8c6d-ffa2a5321190 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:41.791925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c666-4582-4371-8c6d-ffa2a5321190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:41.792227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c666-4582-4371-8c6d-ffa2a5321190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:41.793845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0681c666-4582-4371-8c6d-ffa2a5321190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:41.803025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:41.903440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c666-4582-4371-8c6d-ffa2a5321190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:41.904912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c666-4582-4371-8c6d-ffa2a5321190 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:41.923091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 744/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:51.317819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=82 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:51.920849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=50 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:53.472458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:53.473097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:53.473097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:53.548845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:53.550101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:53.648264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 750/1494] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:11:53.656330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd1f12-2715-4f37-8f52-11ce567edeaa None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:53.656838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd1f12-2715-4f37-8f52-11ce567edeaa None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:53.656941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd1f12-2715-4f37-8f52-11ce567edeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:53.732583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-97cd1f12-2715-4f37-8f52-11ce567edeaa None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:53.733730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-97cd1f12-2715-4f37-8f52-11ce567edeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:53.829972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 745/1495] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:53.835123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:53.836360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:53.847611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c1706-049b-4ca5-89b2-80e92fc44561 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:53.909087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:53.945052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:53.945660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:53.945941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:53.946207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:53.946842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:11:53.947139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:53.948204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:53.948204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:11:53.948204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:11:53.949102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:53.960895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 751/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:11:53.969163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd1f12-2715-4f37-8f52-11ce567edeaa None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:53.979286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd1f12-2715-4f37-8f52-11ce567edeaa None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:54.040965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:54.075312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:54.075955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:54.076239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:54.076515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:54.077150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:54.078960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING py.warnings [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:54.078960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: warnings.warn(msg) Aug 17 16:11:54.078960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: Aug 17 16:11:54.080204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:54.141303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 746/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:11:53 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:11:54.146053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:54.147588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:54.182137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6376b-aba9-4241-964a-c3446d215960 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:54.287928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:54.288537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:54.288817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:54.289085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:54.289709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:54.290732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:54.290732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:11:54.290732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:11:54.292014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:54.334188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 752/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:11:54 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:11:54.338408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:54.339990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:54.402135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55715d9e-3784-4802-a2a7-9471a1e656ef admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:54.485370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:54.496476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:54.497081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:54.497364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:54.497635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:54.498275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:54.499292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING py.warnings [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:54.499292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: warnings.warn(msg) Aug 17 16:11:54.499292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: Aug 17 16:11:54.500224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:54.513825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 747/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:11:54.518265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:54.520873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:54.533297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3da0b-eae5-442e-8595-2eca91fad7f3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:54.562528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:54.638401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f338a07-06de-4408-b8ee-cbafc904de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:54.639019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f338a07-06de-4408-b8ee-cbafc904de32 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:54.639302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f338a07-06de-4408-b8ee-cbafc904de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:54.639579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f338a07-06de-4408-b8ee-cbafc904de32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:54.640267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f338a07-06de-4408-b8ee-cbafc904de32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:54.641276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-5f338a07-06de-4408-b8ee-cbafc904de32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:54.641276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:11:54.641276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:11:54.642200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f338a07-06de-4408-b8ee-cbafc904de32 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:54.654552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 753/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:11:54.658948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:54.660703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:54.694507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ec7a8-5d63-4a31-b912-d3ef0d32081e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:54.787408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f215518-6a0a-4d56-9a96-d1fc5c380f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:54.788107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f215518-6a0a-4d56-9a96-d1fc5c380f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:54.788412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f215518-6a0a-4d56-9a96-d1fc5c380f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:54.788781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f215518-6a0a-4d56-9a96-d1fc5c380f67 admin admin] PATH_INFO: `/v3/projects/17724ca9f0da4f1c83644d79fde297d1/users/7de538a251984677bde296816692ef76/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:54.811334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f215518-6a0a-4d56-9a96-d1fc5c380f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17724ca9f0da4f1c83644d79fde297d1, user_id=7de538a251984677bde296816692ef76, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:54.812410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING py.warnings [None req-3f215518-6a0a-4d56-9a96-d1fc5c380f67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:54.812410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: warnings.warn(msg) Aug 17 16:11:54.812410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: Aug 17 16:11:54.814450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f215518-6a0a-4d56-9a96-d1fc5c380f67 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:54.839887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 748/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:11:54 2022] PUT /identity/v3/projects/17724ca9f0da4f1c83644d79fde297d1/users/7de538a251984677bde296816692ef76/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:11:54.852541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1e5a-722b-4f8e-a308-2fd34ddc50b6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:54.852863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1e5a-722b-4f8e-a308-2fd34ddc50b6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:54.853147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea1e5a-722b-4f8e-a308-2fd34ddc50b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:54.910318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-58ea1e5a-722b-4f8e-a308-2fd34ddc50b6 None None] MFA Rules not processed for user `7de538a251984677bde296816692ef76`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:54.911515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-58ea1e5a-722b-4f8e-a308-2fd34ddc50b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:54.987991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 754/1502] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:55.001858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df80a-f101-413b-8d50-c8748cc673e3 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:55.002149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df80a-f101-413b-8d50-c8748cc673e3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:55.002425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2df80a-f101-413b-8d50-c8748cc673e3 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:55.003785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 749/1503] 10.222.0.60 () {54 vars in 964 bytes} [Wed Aug 17 16:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:11:55.008903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c3001-6197-48c5-8c56-39b154a8f7a6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:55.009197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c3001-6197-48c5-8c56-39b154a8f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:55.009475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c3001-6197-48c5-8c56-39b154a8f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:55.041080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:55.088026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d11c3001-6197-48c5-8c56-39b154a8f7a6 None None] MFA Rules not processed for user `3474a82d27d04dcc9b9818608b00fb48`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:55.089178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d11c3001-6197-48c5-8c56-39b154a8f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:55.166351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 755/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Wed Aug 17 16:11:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:55.174315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df80a-f101-413b-8d50-c8748cc673e3 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:55.176584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ba2df80a-f101-413b-8d50-c8748cc673e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:55.227403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:55.281107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2df80a-f101-413b-8d50-c8748cc673e3 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:55.354986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:55.355607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:55.355919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:55.356200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:55.357832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:55.574506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:55.575988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:55.579508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:55.595493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 750/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:11:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:11:55.645429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43442-7927-4c42-bb96-fd88b6956662 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:55.645963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43442-7927-4c42-bb96-fd88b6956662 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:55.646219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43442-7927-4c42-bb96-fd88b6956662 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:55.647543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 756/1506] 10.222.0.60 () {52 vars in 830 bytes} [Wed Aug 17 16:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:11:55.651236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:55.652489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:55.751172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2db1de-1b6b-42e3-847f-9fb883544414 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:55.844495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:55.845136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:55.845417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:55.845695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] PATH_INFO: `/v3/users/7de538a251984677bde296816692ef76` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:55.858865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de538a251984677bde296816692ef76)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:55.859956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING py.warnings [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:55.859956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: warnings.warn(msg) Aug 17 16:11:55.859956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: Aug 17 16:11:55.861167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:55.871005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:55.931567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de538a251984677bde296816692ef76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:55.932024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de538a251984677bde296816692ef76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:55.932653 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de538a251984677bde296816692ef76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:55.960487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de538a251984677bde296816692ef76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:55.975645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de538a251984677bde296816692ef76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:55.990427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 751/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:11:55 2022] DELETE /identity/v3/users/7de538a251984677bde296816692ef76 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:11:55.994891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:55.995181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:55.995460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:56.053958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:56.055163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:56.131920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:56.145004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 757/1508] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:11:56.154534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:56.155827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:56.266295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe402c0-8972-47da-8590-d1053b870168 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:56.320848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:56.341906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93308a5-e7a9-4dbd-a94c-46a80fa22240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:56.342516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93308a5-e7a9-4dbd-a94c-46a80fa22240 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:56.342792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93308a5-e7a9-4dbd-a94c-46a80fa22240 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:56.343062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93308a5-e7a9-4dbd-a94c-46a80fa22240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:56.344756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a93308a5-e7a9-4dbd-a94c-46a80fa22240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:56.452427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93308a5-e7a9-4dbd-a94c-46a80fa22240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:56.453793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93308a5-e7a9-4dbd-a94c-46a80fa22240 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:56.471783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 752/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:11:56.803829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:56.805268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:56.820009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56f31-e32f-400c-9184-6487fbcc621d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:56.920352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:56.920992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:56.921271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:56.921549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] PATH_INFO: `/v3/projects/17724ca9f0da4f1c83644d79fde297d1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:56.932274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17724ca9f0da4f1c83644d79fde297d1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:56.933324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:56.933324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:11:56.933324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:11:56.934529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:56.992429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17724ca9f0da4f1c83644d79fde297d1', 'request_id': 'req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:56.998349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17724ca9f0da4f1c83644d79fde297d1', 'request_id': 'req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:57.008644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17724ca9f0da4f1c83644d79fde297d1', 'request_id': 'req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:57.038928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] The token cache is being invalidate because project 17724ca9f0da4f1c83644d79fde297d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:11:57.039219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:57.039744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c020ffd6-2ec2-43a3-88a1-ba1ea114e33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:57.041055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 758/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:11:56 2022] DELETE /identity/v3/projects/17724ca9f0da4f1c83644d79fde297d1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:12:06.469555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=62 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:12:07.036980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:27.256242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc770-552d-4c6e-a594-d6ba9bb17107 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:27.256838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc770-552d-4c6e-a594-d6ba9bb17107 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:27.256838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fc770-552d-4c6e-a594-d6ba9bb17107 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:27.258202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:27.263059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578180-2a1b-4fd9-9055-db1ea1b36bf5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:27.263512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578180-2a1b-4fd9-9055-db1ea1b36bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:27.263616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578180-2a1b-4fd9-9055-db1ea1b36bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:27.343629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-50578180-2a1b-4fd9-9055-db1ea1b36bf5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:27.344870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-50578180-2a1b-4fd9-9055-db1ea1b36bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:27.448346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:27.602958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fc770-552d-4c6e-a594-d6ba9bb17107 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:27.605052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-535fc770-552d-4c6e-a594-d6ba9bb17107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:27.723543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fc770-552d-4c6e-a594-d6ba9bb17107 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:27.729519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffcc95-62ae-4606-96b5-f47525927837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:27.730129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffcc95-62ae-4606-96b5-f47525927837 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:27.730411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffcc95-62ae-4606-96b5-f47525927837 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:27.730685 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffcc95-62ae-4606-96b5-f47525927837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:27.739233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffcc95-62ae-4606-96b5-f47525927837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:27.740865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffcc95-62ae-4606-96b5-f47525927837 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:27.750146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 754/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:28.276422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5cf6-1976-402f-8b4d-c49c8ebd99f3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:28.276959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5cf6-1976-402f-8b4d-c49c8ebd99f3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:28.276959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5cf6-1976-402f-8b4d-c49c8ebd99f3 None None] PATH_INFO: `/v3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:28.278852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 760/1514] 10.222.0.42 () {54 vars in 925 bytes} [Wed Aug 17 16:13:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:13:28.284841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe337ab-162f-451e-879c-75ae905a49fd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:28.285301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe337ab-162f-451e-879c-75ae905a49fd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:28.285401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe337ab-162f-451e-879c-75ae905a49fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:28.352738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cbe337ab-162f-451e-879c-75ae905a49fd None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:28.354131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cbe337ab-162f-451e-879c-75ae905a49fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:28.420727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:28.426534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 755/1515] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 17 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:28.591870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01c99-55cb-4755-af20-d27969c540bb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:28.592090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01c99-55cb-4755-af20-d27969c540bb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:28.592329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01c99-55cb-4755-af20-d27969c540bb None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:28.593663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 761/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:28.599289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bab0c-678d-4a91-ab79-02a0852801f7 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:28.599584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bab0c-678d-4a91-ab79-02a0852801f7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:28.599897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bab0c-678d-4a91-ab79-02a0852801f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:28.619452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c32bab0c-678d-4a91-ab79-02a0852801f7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:28.620697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c32bab0c-678d-4a91-ab79-02a0852801f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:28.628619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 756/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:13:28.781664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01c99-55cb-4755-af20-d27969c540bb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:28.796130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01c99-55cb-4755-af20-d27969c540bb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:28.801717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f7576-6f54-4129-8c9e-fa83a3471024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:28.802310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f7576-6f54-4129-8c9e-fa83a3471024 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:28.802589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f7576-6f54-4129-8c9e-fa83a3471024 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:28.802858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f7576-6f54-4129-8c9e-fa83a3471024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:28.810877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f7576-6f54-4129-8c9e-fa83a3471024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:28.812485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f7576-6f54-4129-8c9e-fa83a3471024 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:28.822402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 762/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:37.585783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7e09-236d-47e2-a3bd-3bff4fccaeff None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:37.586353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7e09-236d-47e2-a3bd-3bff4fccaeff None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:37.586353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7e09-236d-47e2-a3bd-3bff4fccaeff None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:37.587606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 757/1519] 10.222.0.60 () {54 vars in 961 bytes} [Wed Aug 17 16:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:37.592708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b1fd-6f62-48eb-b2b0-8c938a9abe7d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:37.593149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b1fd-6f62-48eb-b2b0-8c938a9abe7d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:37.593284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863b1fd-6f62-48eb-b2b0-8c938a9abe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:37.613533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9863b1fd-6f62-48eb-b2b0-8c938a9abe7d None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:37.614858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9863b1fd-6f62-48eb-b2b0-8c938a9abe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:37.623479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 763/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Aug 17 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:37.633409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7e09-236d-47e2-a3bd-3bff4fccaeff None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:37.650290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7e09-236d-47e2-a3bd-3bff4fccaeff None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:37.655233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209b095-711b-4b1a-b633-f7f71e8e6f47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:37.655863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209b095-711b-4b1a-b633-f7f71e8e6f47 service placement] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:37.656147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209b095-711b-4b1a-b633-f7f71e8e6f47 service placement] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:37.656423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209b095-711b-4b1a-b633-f7f71e8e6f47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:37.665628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209b095-711b-4b1a-b633-f7f71e8e6f47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:37.667211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209b095-711b-4b1a-b633-f7f71e8e6f47 service placement] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:37.677349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 758/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:40.053391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839b4c-6501-4d68-bd32-5d4e6013cb30 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:40.053968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839b4c-6501-4d68-bd32-5d4e6013cb30 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:40.053968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff839b4c-6501-4d68-bd32-5d4e6013cb30 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:40.055281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:40.060313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aba62-0874-498f-a51f-6f854ef345e8 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:40.060738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aba62-0874-498f-a51f-6f854ef345e8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:40.060867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aba62-0874-498f-a51f-6f854ef345e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:40.080286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-832aba62-0874-498f-a51f-6f854ef345e8 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:40.082171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-832aba62-0874-498f-a51f-6f854ef345e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:40.090303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:13:40.245106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff839b4c-6501-4d68-bd32-5d4e6013cb30 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:40.260187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff839b4c-6501-4d68-bd32-5d4e6013cb30 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:40.265505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d84e91-a78a-44ac-b41b-1e060b4b656f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:40.266096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84e91-a78a-44ac-b41b-1e060b4b656f service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:40.266372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84e91-a78a-44ac-b41b-1e060b4b656f service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:40.266640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d84e91-a78a-44ac-b41b-1e060b4b656f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:40.274747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d84e91-a78a-44ac-b41b-1e060b4b656f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:40.276333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d84e91-a78a-44ac-b41b-1e060b4b656f service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:40.286078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 765/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:41.126574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3f45c-898a-48d9-a8f3-d7b067d779b3 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:41.127117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3f45c-898a-48d9-a8f3-d7b067d779b3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:41.127117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3f45c-898a-48d9-a8f3-d7b067d779b3 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:41.128795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:41.133654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502e3c8-db03-41cf-ac4d-74deea3d3560 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:41.134094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502e3c8-db03-41cf-ac4d-74deea3d3560 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:41.134272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502e3c8-db03-41cf-ac4d-74deea3d3560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:41.154255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f502e3c8-db03-41cf-ac4d-74deea3d3560 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:41.155457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f502e3c8-db03-41cf-ac4d-74deea3d3560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:41.163952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:41.314874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3f45c-898a-48d9-a8f3-d7b067d779b3 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:41.329243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3f45c-898a-48d9-a8f3-d7b067d779b3 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:41.335320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e491ed-89ab-4647-985c-48c3660ec1e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:41.335946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e491ed-89ab-4647-985c-48c3660ec1e8 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:41.336230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e491ed-89ab-4647-985c-48c3660ec1e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:41.336502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e491ed-89ab-4647-985c-48c3660ec1e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:41.344719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e491ed-89ab-4647-985c-48c3660ec1e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:41.347082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e491ed-89ab-4647-985c-48c3660ec1e8 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:41.356822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 761/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:45.343107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf5d9d-b469-436c-816f-c089fc92365a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:45.343676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf5d9d-b469-436c-816f-c089fc92365a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:45.343676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf5d9d-b469-436c-816f-c089fc92365a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:45.345142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:45.350736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9a493-de7f-496f-b75b-9032406dc2ca None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:45.351409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9a493-de7f-496f-b75b-9032406dc2ca None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:45.351543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9a493-de7f-496f-b75b-9032406dc2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:45.371081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5ad9a493-de7f-496f-b75b-9032406dc2ca None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:45.372317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5ad9a493-de7f-496f-b75b-9032406dc2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:45.380149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:45.661732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf5d9d-b469-436c-816f-c089fc92365a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:45.663433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7fbf5d9d-b469-436c-816f-c089fc92365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:45.697193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:45.744081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf5d9d-b469-436c-816f-c089fc92365a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:45.747658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e468c5d-fac1-437a-aed8-458436d99d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:45.748308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e468c5d-fac1-437a-aed8-458436d99d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:45.748593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e468c5d-fac1-437a-aed8-458436d99d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:45.748874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e468c5d-fac1-437a-aed8-458436d99d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:45.758475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e468c5d-fac1-437a-aed8-458436d99d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:45.759937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e468c5d-fac1-437a-aed8-458436d99d77 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:45.769353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 768/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:47.694265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbd353-c990-42dc-af6f-b54d87bfe878 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:47.694850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbd353-c990-42dc-af6f-b54d87bfe878 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:47.694850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbd353-c990-42dc-af6f-b54d87bfe878 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:47.696180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:47.701262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbddbb-5649-4ff6-83cd-1afa8b22c8f0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:47.701715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbddbb-5649-4ff6-83cd-1afa8b22c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:47.701825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbddbb-5649-4ff6-83cd-1afa8b22c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:47.721728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-62bbddbb-5649-4ff6-83cd-1afa8b22c8f0 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:47.722926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-62bbddbb-5649-4ff6-83cd-1afa8b22c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:47.731063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:13:48.026120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbd353-c990-42dc-af6f-b54d87bfe878 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:48.036994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbd353-c990-42dc-af6f-b54d87bfe878 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:48.040452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a4cf0-9549-4838-a577-73b4bb5fdecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:48.041039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a4cf0-9549-4838-a577-73b4bb5fdecc service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:48.041314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a4cf0-9549-4838-a577-73b4bb5fdecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:48.041582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a4cf0-9549-4838-a577-73b4bb5fdecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:48.050886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a4cf0-9549-4838-a577-73b4bb5fdecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:48.052359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a4cf0-9549-4838-a577-73b4bb5fdecc service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:48.061655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 764/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:51.610061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a93c1-195e-4fbd-8832-fbf1642ed295 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:51.610597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a93c1-195e-4fbd-8832-fbf1642ed295 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:51.610597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a93c1-195e-4fbd-8832-fbf1642ed295 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:51.612022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:51.620200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b130-42c2-4477-8c5a-e173fe7352b8 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:51.620638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b130-42c2-4477-8c5a-e173fe7352b8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:51.620786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1b130-42c2-4477-8c5a-e173fe7352b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:51.640739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-25c1b130-42c2-4477-8c5a-e173fe7352b8 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:51.641945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-25c1b130-42c2-4477-8c5a-e173fe7352b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:51.650101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:52.204093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a93c1-195e-4fbd-8832-fbf1642ed295 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:52.205860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ed3a93c1-195e-4fbd-8832-fbf1642ed295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:52.284245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a93c1-195e-4fbd-8832-fbf1642ed295 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:52.288536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827095c0-26da-415e-93f8-a9841107ea2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:52.289140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827095c0-26da-415e-93f8-a9841107ea2a service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:52.289421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827095c0-26da-415e-93f8-a9841107ea2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:52.289694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827095c0-26da-415e-93f8-a9841107ea2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:52.299893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827095c0-26da-415e-93f8-a9841107ea2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:52.301518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827095c0-26da-415e-93f8-a9841107ea2a service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:52.312931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 771/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:54.248551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1e56e-2dec-4082-98c7-b7cb7bbb187e None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:54.249119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1e56e-2dec-4082-98c7-b7cb7bbb187e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:54.249119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1e56e-2dec-4082-98c7-b7cb7bbb187e None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:54.250460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:54.256538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e00682-a630-4634-a1f4-6c09f53641f1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:54.256929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e00682-a630-4634-a1f4-6c09f53641f1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:54.257091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e00682-a630-4634-a1f4-6c09f53641f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:54.277254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d4e00682-a630-4634-a1f4-6c09f53641f1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:54.278454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d4e00682-a630-4634-a1f4-6c09f53641f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:54.286908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:54.852301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1e56e-2dec-4082-98c7-b7cb7bbb187e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:54.854494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a0a1e56e-2dec-4082-98c7-b7cb7bbb187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:54.867526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1e56e-2dec-4082-98c7-b7cb7bbb187e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:54.870974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39b6a6-455d-4cb3-aa58-be9ce5ff4e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:54.871561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b6a6-455d-4cb3-aa58-be9ce5ff4e0e service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:54.871865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b6a6-455d-4cb3-aa58-be9ce5ff4e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:54.872142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39b6a6-455d-4cb3-aa58-be9ce5ff4e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:54.881368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b6a6-455d-4cb3-aa58-be9ce5ff4e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:54.882782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39b6a6-455d-4cb3-aa58-be9ce5ff4e0e service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:54.892011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 767/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:14:04.272358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=63 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:04.887961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=37 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:20.017761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a3fcb-10db-4b34-828f-4f6091aeb0bc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.018544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a3fcb-10db-4b34-828f-4f6091aeb0bc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.018544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a3fcb-10db-4b34-828f-4f6091aeb0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.050541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-335a3fcb-10db-4b34-828f-4f6091aeb0bc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.051767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-335a3fcb-10db-4b34-828f-4f6091aeb0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.063046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 773/1540] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:20.072356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70bfc-9df4-4b5e-8d49-0ad6e5594222 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.073757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70bfc-9df4-4b5e-8d49-0ad6e5594222 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.074103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70bfc-9df4-4b5e-8d49-0ad6e5594222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.105589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-aba70bfc-9df4-4b5e-8d49-0ad6e5594222 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.107150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-aba70bfc-9df4-4b5e-8d49-0ad6e5594222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.119991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 768/1541] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:20.124523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a3fcb-10db-4b34-828f-4f6091aeb0bc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.135469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a3fcb-10db-4b34-828f-4f6091aeb0bc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.151893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.152526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.152805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.153081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.153740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:20.154282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.155922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.174823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 774/1542] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:20.182953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70bfc-9df4-4b5e-8d49-0ad6e5594222 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.197466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70bfc-9df4-4b5e-8d49-0ad6e5594222 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.202974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3d301-b968-4962-a5a8-671f1a31c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.203882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d301-b968-4962-a5a8-671f1a31c554 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.204970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d301-b968-4962-a5a8-671f1a31c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.205635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3d301-b968-4962-a5a8-671f1a31c554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.206497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d301-b968-4962-a5a8-671f1a31c554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.210494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3d301-b968-4962-a5a8-671f1a31c554 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.273689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 769/1543] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:20.277344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.292818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d053122-54bf-462c-bddc-baf741bf8362 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.362874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd733-fcbe-441d-9701-665c6d1cd33a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.363531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd733-fcbe-441d-9701-665c6d1cd33a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.364047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfd733-fcbe-441d-9701-665c6d1cd33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.388784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.389501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.394401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-3abfd733-fcbe-441d-9701-665c6d1cd33a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.396053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.396367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.396478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3abfd733-fcbe-441d-9701-665c6d1cd33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.397066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.402568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.415723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 770/1544] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:20.426589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfb0f-eaca-4dac-b0d5-add882630c75 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.427360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfb0f-eaca-4dac-b0d5-add882630c75 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.428251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfb0f-eaca-4dac-b0d5-add882630c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.442794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 775/1545] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:20.446812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.462065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f7edfb0f-eaca-4dac-b0d5-add882630c75 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.463637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f7edfb0f-eaca-4dac-b0d5-add882630c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.468216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099eaa8-7ccf-4281-8d72-3bb5e368cc93 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.478663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 771/1546] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:20.485329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edfb0f-eaca-4dac-b0d5-add882630c75 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.500672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.502000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.502768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.503060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.503629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edfb0f-eaca-4dac-b0d5-add882630c75 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.503757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.505424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.517349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.517997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.518325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.518604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.519283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:20.519586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.520831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING py.warnings [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:15:20.520831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: warnings.warn(msg) Aug 17 16:15:20.520831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: Aug 17 16:15:20.521758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbc0ae-289e-430d-9f02-a09ded0ffd6f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.523946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 776/1547] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:15:20.528929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.543048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be665c-25a3-48f5-97f7-64978e258cd3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.557854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 772/1548] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:15:20.559181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58e72-520a-43d0-a73c-9cca2a8d4480 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.559386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58e72-520a-43d0-a73c-9cca2a8d4480 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.559663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a58e72-520a-43d0-a73c-9cca2a8d4480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.565375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.566375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.566875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.567361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.568479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.570319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.591795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 777/1549] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:20.593026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.598584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-93a58e72-520a-43d0-a73c-9cca2a8d4480 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.599831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-93a58e72-520a-43d0-a73c-9cca2a8d4480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.614269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8def-6652-4d42-be23-b1f786c00cb1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.617703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 773/1550] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:20.618461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a58e72-520a-43d0-a73c-9cca2a8d4480 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.624043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff35c5-c2db-4f77-879a-e8c294260e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.625038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff35c5-c2db-4f77-879a-e8c294260e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.625532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff35c5-c2db-4f77-879a-e8c294260e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.626036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff35c5-c2db-4f77-879a-e8c294260e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.627862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff35c5-c2db-4f77-879a-e8c294260e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.629143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-7fff35c5-c2db-4f77-879a-e8c294260e62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:15:20.629143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:15:20.629143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:15:20.630856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff35c5-c2db-4f77-879a-e8c294260e62 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.635831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a58e72-520a-43d0-a73c-9cca2a8d4480 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.649253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb4c16-cba2-45ce-8e9b-dcdcc601a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.650080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4c16-cba2-45ce-8e9b-dcdcc601a632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.650360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4c16-cba2-45ce-8e9b-dcdcc601a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.650632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb4c16-cba2-45ce-8e9b-dcdcc601a632 admin admin] PATH_INFO: `/v3/projects/081e95024c5243e8acaa8e0be2d130a9/users/5e73b485d0f14328a085f410488f30a5/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.687963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb4c16-cba2-45ce-8e9b-dcdcc601a632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081e95024c5243e8acaa8e0be2d130a9, user_id=5e73b485d0f14328a085f410488f30a5, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.695057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb4c16-cba2-45ce-8e9b-dcdcc601a632 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.708414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 778/1551] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:20.710309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f27d-e15a-49a1-b22e-61a159483340 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.710905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f27d-e15a-49a1-b22e-61a159483340 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.711384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2f27d-e15a-49a1-b22e-61a159483340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.726982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 774/1552] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:20 2022] PUT /identity/v3/projects/081e95024c5243e8acaa8e0be2d130a9/users/5e73b485d0f14328a085f410488f30a5/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:20.728359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b886-b7a7-48ba-b6ef-52659a7282cb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.728644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b886-b7a7-48ba-b6ef-52659a7282cb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.728972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b886-b7a7-48ba-b6ef-52659a7282cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.756583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f7b2f27d-e15a-49a1-b22e-61a159483340 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.758175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f7b2f27d-e15a-49a1-b22e-61a159483340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.760542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1db8b886-b7a7-48ba-b6ef-52659a7282cb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.761776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1db8b886-b7a7-48ba-b6ef-52659a7282cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.856492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 779/1553] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:20.860317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2f27d-e15a-49a1-b22e-61a159483340 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:20.868298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2f27d-e15a-49a1-b22e-61a159483340 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:20.872831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb3858-50e4-4384-b103-ba3409430356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:20.872994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 775/1554] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:20.873500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb3858-50e4-4384-b103-ba3409430356 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.873786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb3858-50e4-4384-b103-ba3409430356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.874121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb3858-50e4-4384-b103-ba3409430356 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.874443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f192d-29d4-4267-9f93-74752a81b987 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.874725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f192d-29d4-4267-9f93-74752a81b987 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.874847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb3858-50e4-4384-b103-ba3409430356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:20.875006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f192d-29d4-4267-9f93-74752a81b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.876727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb3858-50e4-4384-b103-ba3409430356 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:20.899848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 780/1555] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:20.900700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a312ff3-dbf1-4689-8cd4-9bb408be7af3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.900994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a312ff3-dbf1-4689-8cd4-9bb408be7af3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.901271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a312ff3-dbf1-4689-8cd4-9bb408be7af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.905534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ac6f192d-29d4-4267-9f93-74752a81b987 None None] MFA Rules not processed for user `5e73b485d0f14328a085f410488f30a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.906775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ac6f192d-29d4-4267-9f93-74752a81b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.920883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1a312ff3-dbf1-4689-8cd4-9bb408be7af3 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.922075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1a312ff3-dbf1-4689-8cd4-9bb408be7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.930371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 781/1556] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:20.932851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cefa8-b6e5-433d-8bda-bffec0e6320a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.933596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cefa8-b6e5-433d-8bda-bffec0e6320a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.933880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cefa8-b6e5-433d-8bda-bffec0e6320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.943587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:20.963151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f90cefa8-b6e5-433d-8bda-bffec0e6320a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:20.964405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f90cefa8-b6e5-433d-8bda-bffec0e6320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:20.973254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 782/1557] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:20.974464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963be07-83cd-4fc3-b7a8-042e4aa5b359 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.974748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963be07-83cd-4fc3-b7a8-042e4aa5b359 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.975022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963be07-83cd-4fc3-b7a8-042e4aa5b359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.979056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:20.994512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 776/1558] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:20.996497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64fd5-f216-4e91-9e9b-74a48b542670 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:20.997401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64fd5-f216-4e91-9e9b-74a48b542670 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:20.997893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b64fd5-f216-4e91-9e9b-74a48b542670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:20.999094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b963be07-83cd-4fc3-b7a8-042e4aa5b359 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.000320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b963be07-83cd-4fc3-b7a8-042e4aa5b359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.010375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 783/1559] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:21.011676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963be07-83cd-4fc3-b7a8-042e4aa5b359 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.023460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-39b64fd5-f216-4e91-9e9b-74a48b542670 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.024125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963be07-83cd-4fc3-b7a8-042e4aa5b359 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.024722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-39b64fd5-f216-4e91-9e9b-74a48b542670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.028718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.029323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.029601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.029872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.030513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:21.030816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.033363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.034515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 777/1560] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:21.035537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea752-c0cd-492d-a670-4891aa22e191 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.035923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea752-c0cd-492d-a670-4891aa22e191 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.036155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea752-c0cd-492d-a670-4891aa22e191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.049175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 784/1561] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:21.049876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.060656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21774b9-fca7-41c8-ac59-381557029223 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.061640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-925ea752-c0cd-492d-a670-4891aa22e191 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.064287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-925ea752-c0cd-492d-a670-4891aa22e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.066486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca85e8d-f20c-4148-8b49-f6e6fcfe175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.067294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca85e8d-f20c-4148-8b49-f6e6fcfe175d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.067575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca85e8d-f20c-4148-8b49-f6e6fcfe175d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.068030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca85e8d-f20c-4148-8b49-f6e6fcfe175d admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.068833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca85e8d-f20c-4148-8b49-f6e6fcfe175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.070531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca85e8d-f20c-4148-8b49-f6e6fcfe175d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.074037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 778/1562] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:21.075354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b741-2ff2-4c36-b6c1-9bd5700d1527 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.075644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b741-2ff2-4c36-b6c1-9bd5700d1527 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.075968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04b741-2ff2-4c36-b6c1-9bd5700d1527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.083925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 785/1563] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:21.088100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89714b-afd5-48cb-aa86-d96a9cef5aa7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.088388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89714b-afd5-48cb-aa86-d96a9cef5aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.088663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89714b-afd5-48cb-aa86-d96a9cef5aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.097679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ac04b741-2ff2-4c36-b6c1-9bd5700d1527 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.098902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ac04b741-2ff2-4c36-b6c1-9bd5700d1527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.107502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 779/1564] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:21.108558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04b741-2ff2-4c36-b6c1-9bd5700d1527 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.111515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1e89714b-afd5-48cb-aa86-d96a9cef5aa7 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.112764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1e89714b-afd5-48cb-aa86-d96a9cef5aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.121475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04b741-2ff2-4c36-b6c1-9bd5700d1527 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.122284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 786/1565] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:21.123618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbe158-1820-4589-bce3-4449babcc308 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.123938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbe158-1820-4589-bce3-4449babcc308 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.124377 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbe158-1820-4589-bce3-4449babcc308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.134433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.135496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.135918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.136197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.137070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.139407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.145087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c7dbe158-1820-4589-bce3-4449babcc308 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.146679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c7dbe158-1820-4589-bce3-4449babcc308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.161181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 787/1566] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:21.162747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983639-f2ed-4ca7-b79e-0a331c6873c9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.163043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983639-f2ed-4ca7-b79e-0a331c6873c9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.163323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983639-f2ed-4ca7-b79e-0a331c6873c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.174323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 780/1567] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.176762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.191357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-84983639-f2ed-4ca7-b79e-0a331c6873c9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.192636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-84983639-f2ed-4ca7-b79e-0a331c6873c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.255868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed037e35-2137-4952-8e69-7f0595f1ca54 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.265765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.266411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.266703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.267452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.268132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.273545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 788/1568] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:21.277448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983639-f2ed-4ca7-b79e-0a331c6873c9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.277565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.285865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983639-f2ed-4ca7-b79e-0a331c6873c9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.290526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.291136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.291414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.291689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.292449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:21.292752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.294464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.308245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 789/1569] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:21.314132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 781/1570] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.314132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.317366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.329367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66359e41-7a55-485c-8232-77e6892a853c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.389928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d665-c6f0-4134-b7c7-5f9d21b57d2a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.392523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.393427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.393812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.394094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.394756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.395139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.395704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.396023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.396731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.396843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.397036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:21.397396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.399793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.407416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 790/1571] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:21.408810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.418331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a55d-baf0-4791-9907-87422c8b0838 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.427949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 782/1572] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:21.427949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.428199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.428199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.428199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.428199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.428532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:21.428532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.428532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.436136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c8078-8b12-4b6b-9a02-8caf2440f2fb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.441376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.441986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.442264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.443923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.443923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:21.443923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.444233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 791/1573] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:21.444817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.445134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.456625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe33457-647c-42aa-86e4-d70a1e7c3d25 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.462905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 783/1574] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:21.463772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.463917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.464584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.464819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.465468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.465817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.467764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.476699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e689b-9560-4bf9-9b02-ef174a672006 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.481311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.481932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.482213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.482573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.483933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:21.484582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.487014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.493972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 792/1575] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.495150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.502915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 784/1576] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:21.503961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.505544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:21.513178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a1f43-741d-4dc6-b185-07a913492189 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.517822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11b4de-68b4-4e41-b1a4-14b165615067 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.520250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.520971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.521249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.521517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.522178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.522537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.523154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.523437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.523748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.524237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.524429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.526644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.531873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:21.549872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 793/1577] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/users => generated 291 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.550948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.561831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80835f03-fe4e-4d2c-bf6f-b0db453ea049 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.562971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 785/1578] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.563662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.635173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d398999-20a6-483e-81c2-86a8805bda10 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.636239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.636949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.637223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.637498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] PATH_INFO: `/v3/projects/0fef305b90d942ea823ca9ba799bb9af/users/d8f2a3a6a0bc461d9e7ba14c8a037b59/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.640087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.640641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.640927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.641194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.642358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.645457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.654799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fef305b90d942ea823ca9ba799bb9af, user_id=d8f2a3a6a0bc461d9e7ba14c8a037b59, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.655892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:15:21.655892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:15:21.655892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:15:21.658568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.673614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 794/1579] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:21 2022] PUT /identity/v3/projects/0fef305b90d942ea823ca9ba799bb9af/users/d8f2a3a6a0bc461d9e7ba14c8a037b59/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:21.674687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.678600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 786/1580] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/projects => generated 393 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.679737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.745623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d659c7b-0c4b-476f-9fb2-1b89b31a4df8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.750991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.751753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.752125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.752325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.752959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.754066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2555-cb91-4efd-8254-abc79358d65c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.754862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.759069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.759751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.760072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.760356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.761004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.763001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.790386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 795/1581] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.790386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.811711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 787/1582] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/projects => generated 353 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.811711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.862561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:21.868874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90da045-4ab2-4551-84a9-fc269f217b15 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.870171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:21.874416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.875130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.875460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.875765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.876901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e640d-79aa-4e8d-8329-4c85a73595a5 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.877086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.879070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.882339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.882950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.883327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.883607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.884269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.886188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.889524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 796/1583] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:21.890383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.901016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69e406-a3a7-4e87-b8bf-aef468ebd68e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.906674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45bf2a-ac1d-43f3-a49f-774cb899a2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.907292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45bf2a-ac1d-43f3-a49f-774cb899a2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.907628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45bf2a-ac1d-43f3-a49f-774cb899a2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.908087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45bf2a-ac1d-43f3-a49f-774cb899a2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.908596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45bf2a-ac1d-43f3-a49f-774cb899a2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.910547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45bf2a-ac1d-43f3-a49f-774cb899a2a8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:21.918235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 788/1584] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:21.918235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:21.924536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 797/1585] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:21.926080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb553c-1496-4400-8350-07b9bbe7a223 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.926372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb553c-1496-4400-8350-07b9bbe7a223 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.926650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb553c-1496-4400-8350-07b9bbe7a223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.945574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c4bb553c-1496-4400-8350-07b9bbe7a223 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:21.946784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c4bb553c-1496-4400-8350-07b9bbe7a223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:21.981106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50419f-1503-4b80-bd86-9529a04fc52b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:21.986399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:21.987014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:21.987294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:21.987572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:21.988231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:21.989317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING py.warnings [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:15:21.989317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: warnings.warn(msg) Aug 17 16:15:21.989317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: Aug 17 16:15:21.990532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.009382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 798/1586] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:22.010326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb553c-1496-4400-8350-07b9bbe7a223 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.013432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 789/1587] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:21 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:22.014074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.025221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b4d56-f91b-45ab-bff9-8b17c38ff243 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.026143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb553c-1496-4400-8350-07b9bbe7a223 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.029854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.030453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.030645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.030773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.031121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.031255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.031491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.031754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.031902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.032938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.034247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.036460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.056754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 790/1588] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:22 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:22.057626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.070723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 799/1589] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:22 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:22.070723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.072168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0f51c-d06d-4203-851a-d47a61ea7de1 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.076723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.077374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.077592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.077955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.078516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.081061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.087005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0242d-d9c9-4a83-9298-66ec70335e6f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.093030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.093448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.093695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.094243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] PATH_INFO: `/v3/projects/0cbf47a2439f4a00a0c4d4cb3599cab0/users/34e8642eea3342b5bfb6c51df67bd173/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.103350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 791/1590] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:22 2022] POST /identity/v3/users => generated 277 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:22.107299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.110584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbf47a2439f4a00a0c4d4cb3599cab0, user_id=34e8642eea3342b5bfb6c51df67bd173, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.113305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.116910 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb8374-cd52-4904-9fc7-d4cd422be092 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.122338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.122959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.123260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.123541 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.124247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.126188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.127256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 800/1591] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/0cbf47a2439f4a00a0c4d4cb3599cab0/users/34e8642eea3342b5bfb6c51df67bd173/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.128103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.149286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 792/1592] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:22 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:22.150102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.161835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd08bf-597e-4097-ba26-f1a99e417911 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.193382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cec59-22c7-443a-b3e0-01eb59815d6c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.198471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.199106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.199383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.199654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.200340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.202444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.213767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 801/1593] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.216698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.221866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.222486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.222770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.223048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.223704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.225354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.238953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 793/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.238953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.246695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e7d79-bbe5-4aad-b1ff-91049d08536b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.252223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.252998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.253421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.253851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.254708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.256613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.262033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:22.277102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 794/1595] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.277102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.279289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed9fed-7d3b-4666-830f-9726f0293d92 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.281569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:22.284553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.285142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.285406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.285685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.287835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550412e-7333-4370-8a99-a768c6ffd22f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.293582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.294251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.294603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.294947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.295074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.295727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.296491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.297525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.307097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 802/1596] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:22.308269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.311686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 795/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.311686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.319379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4cdc-dc56-4b50-bcf7-2086d8b4472d service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.321874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924facbf-93bc-4c1c-b0bd-7efc73add1b6 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.324705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.325319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.325602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.325876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.326551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.327744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.328185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.328845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.329340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.330354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.331274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.332979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.343688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 803/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.343688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.348493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 796/1599] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.349399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.357703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958168-bd60-4618-80b0-4244787eb863 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.359556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4283a-63c0-403d-9790-5aab4b27031b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.363472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.364278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.364422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.365189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.365308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.365412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.365503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.365503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] PATH_INFO: `/v3/projects/57de94057c094ac788a2708c46788f48/users/7bd4ec50fe384170971aabbee75501aa/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.366074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.367757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.380647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 804/1600] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.381805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.386381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57de94057c094ac788a2708c46788f48, user_id=7bd4ec50fe384170971aabbee75501aa, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.389264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.393971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04f6a3-8b13-4813-ab58-60f99d7f8083 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.399637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.400309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.400702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.401037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.402191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.404057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.405538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 797/1601] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/57de94057c094ac788a2708c46788f48/users/7bd4ec50fe384170971aabbee75501aa/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.406483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.425086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 805/1602] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.426216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.437817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8619af-60b7-47f3-8a7c-5a22f5eaee25 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.482362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b2b0-f7bb-4f0a-ad24-05035e15d12f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.491294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.491294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.491294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.491294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.491628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.492898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.509320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 798/1603] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.509320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.520498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.521205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.521557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.521719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73927b7-d2c4-4928-a77e-9db5c4dd7104 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.521958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.522697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.525001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.527927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.528877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.529356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.529775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.530616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.533134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.537372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 806/1604] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.538041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.544577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 799/1605] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.545626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.554243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99143d1-5f44-4a2e-8494-c152b5248e3a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.557224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd963b19-453b-4806-9bf5-962a961d3775 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.559739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0695390-926f-4071-8cd7-119fa03e2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.560561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695390-926f-4071-8cd7-119fa03e2737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.560889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695390-926f-4071-8cd7-119fa03e2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.561167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0695390-926f-4071-8cd7-119fa03e2737 admin admin] PATH_INFO: `/v3/projects/0cbf47a2439f4a00a0c4d4cb3599cab0/users/34e8642eea3342b5bfb6c51df67bd173/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.562777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.563203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0695390-926f-4071-8cd7-119fa03e2737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbf47a2439f4a00a0c4d4cb3599cab0, user_id=34e8642eea3342b5bfb6c51df67bd173, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.563592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.564509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.564896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.565566 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.566937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0695390-926f-4071-8cd7-119fa03e2737 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.567162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.578490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 807/1606] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/0cbf47a2439f4a00a0c4d4cb3599cab0/users/34e8642eea3342b5bfb6c51df67bd173/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.578938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 800/1607] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:22.580440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.583928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8780-1656-457d-a4a9-d56263f544a5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.584339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8780-1656-457d-a4a9-d56263f544a5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.584720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e8780-1656-457d-a4a9-d56263f544a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.591401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab17b80-91c4-44c0-a138-33330aea0363 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.615416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-749e8780-1656-457d-a4a9-d56263f544a5 None None] MFA Rules not processed for user `7bd4ec50fe384170971aabbee75501aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:22.616797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-749e8780-1656-457d-a4a9-d56263f544a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:22.667442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.668346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.668636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.668915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] PATH_INFO: `/v3/projects/d23a63f9104b44ff9afa19fc00dbbd37/users/79729883ac964badae04665e547634da/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.691128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23a63f9104b44ff9afa19fc00dbbd37, user_id=79729883ac964badae04665e547634da, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.694148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.711487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 801/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/d23a63f9104b44ff9afa19fc00dbbd37/users/79729883ac964badae04665e547634da/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.712131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 808/1609] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:22.712554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.713160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e8780-1656-457d-a4a9-d56263f544a5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.726797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:22.729813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e8780-1656-457d-a4a9-d56263f544a5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.748899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:22.796034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9f98-e60c-4b5f-8fd9-463838667ba5 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.801922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.802691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.803044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.803390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] PATH_INFO: `/v3/projects/ada4e13b032f47708b4fe19f5a61ef1d/users/ccba871c23ef4552a9080767f97c52ba/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.804383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.805245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.805692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.806123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] PATH_INFO: `/v3/projects/34b7fa307d994f2792503e6761f3c079/users/9fe81a429dee4fba8708445dcefa293e/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.824531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada4e13b032f47708b4fe19f5a61ef1d, user_id=ccba871c23ef4552a9080767f97c52ba, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.827354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.828606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b7fa307d994f2792503e6761f3c079, user_id=9fe81a429dee4fba8708445dcefa293e, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.832285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.848679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 809/1611] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/34b7fa307d994f2792503e6761f3c079/users/9fe81a429dee4fba8708445dcefa293e/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.849775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.855899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 802/1611] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/ada4e13b032f47708b4fe19f5a61ef1d/users/ccba871c23ef4552a9080767f97c52ba/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.859997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:22.920588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469fce-43ec-4a07-850f-261729867842 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.926545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a1bb9-fbe3-4c34-8893-f8cca98008ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.927313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1bb9-fbe3-4c34-8893-f8cca98008ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.927664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1bb9-fbe3-4c34-8893-f8cca98008ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.928036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1bb9-fbe3-4c34-8893-f8cca98008ef admin admin] PATH_INFO: `/v3/projects/9c9abca118044d919be7b76d7fdd6e2c/users/79dc209026ce473cad160486c12c5801/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.932393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b8c3-6bae-4e24-b3f6-a1e49ab299fe admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:22.937795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69600b4-6fd7-4dac-9e6c-eecf76e99d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:22.938557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69600b4-6fd7-4dac-9e6c-eecf76e99d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.938878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69600b4-6fd7-4dac-9e6c-eecf76e99d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.939289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69600b4-6fd7-4dac-9e6c-eecf76e99d32 admin admin] PATH_INFO: `/v3/projects/694ac81eb96c46bf9c999a09e34fb496/users/dcb0aae565f84d60a8722c74e83b6682/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.946027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a1bb9-fbe3-4c34-8893-f8cca98008ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9abca118044d919be7b76d7fdd6e2c, user_id=79dc209026ce473cad160486c12c5801, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.948751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a1bb9-fbe3-4c34-8893-f8cca98008ef admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.960088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69600b4-6fd7-4dac-9e6c-eecf76e99d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=694ac81eb96c46bf9c999a09e34fb496, user_id=dcb0aae565f84d60a8722c74e83b6682, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:22.963086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69600b4-6fd7-4dac-9e6c-eecf76e99d32 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:22.966221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 810/1612] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/9c9abca118044d919be7b76d7fdd6e2c/users/79dc209026ce473cad160486c12c5801/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.967653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94329029-150b-4ab8-b940-440db3309d46 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.968003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94329029-150b-4ab8-b940-440db3309d46 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.968262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94329029-150b-4ab8-b940-440db3309d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:22.992416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 803/1613] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:22 2022] PUT /identity/v3/projects/694ac81eb96c46bf9c999a09e34fb496/users/dcb0aae565f84d60a8722c74e83b6682/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:22.993185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac9af-9342-4630-9198-bb57aa7955f4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:22.993458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac9af-9342-4630-9198-bb57aa7955f4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:22.993733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dac9af-9342-4630-9198-bb57aa7955f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.002786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-94329029-150b-4ab8-b940-440db3309d46 None None] MFA Rules not processed for user `34e8642eea3342b5bfb6c51df67bd173`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:23.004755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-94329029-150b-4ab8-b940-440db3309d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:23.024133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-36dac9af-9342-4630-9198-bb57aa7955f4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:23.025832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-36dac9af-9342-4630-9198-bb57aa7955f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:23.088388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 811/1614] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:23.089376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94329029-150b-4ab8-b940-440db3309d46 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.101544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 804/1615] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:23.102913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3df4-d385-4871-b776-9c5d6a95f72e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.103276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3df4-d385-4871-b776-9c5d6a95f72e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.103642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d3df4-d385-4871-b776-9c5d6a95f72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.109098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:23.130210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-648d3df4-d385-4871-b776-9c5d6a95f72e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:23.131450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-648d3df4-d385-4871-b776-9c5d6a95f72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:23.141556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 805/1616] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:23.143788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0f82-41ce-4fb7-8130-8d08e11d7059 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.144103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0f82-41ce-4fb7-8130-8d08e11d7059 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.144383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b0f82-41ce-4fb7-8130-8d08e11d7059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.179833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:23.187305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4d5b0f82-41ce-4fb7-8130-8d08e11d7059 None None] MFA Rules not processed for user `ccba871c23ef4552a9080767f97c52ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:23.191057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4d5b0f82-41ce-4fb7-8130-8d08e11d7059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:23.204113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94329029-150b-4ab8-b940-440db3309d46 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.211946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec029b-dee3-4cc4-bd85-f62866ca5fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.212939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec029b-dee3-4cc4-bd85-f62866ca5fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.213439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec029b-dee3-4cc4-bd85-f62866ca5fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.213815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec029b-dee3-4cc4-bd85-f62866ca5fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.214657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec029b-dee3-4cc4-bd85-f62866ca5fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.219081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec029b-dee3-4cc4-bd85-f62866ca5fc6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.255481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 812/1617] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:23.257103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f9c56-10b4-4837-9da6-401b7ca791ae None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.257398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f9c56-10b4-4837-9da6-401b7ca791ae None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.257679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f9c56-10b4-4837-9da6-401b7ca791ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.292655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-277f9c56-10b4-4837-9da6-401b7ca791ae None None] MFA Rules not processed for user `79dc209026ce473cad160486c12c5801`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:23.293757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 806/1618] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:23.293877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-277f9c56-10b4-4837-9da6-401b7ca791ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:23.295139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48db0-1a1b-4026-8768-e902c41a7d93 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.295869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48db0-1a1b-4026-8768-e902c41a7d93 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.296452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae48db0-1a1b-4026-8768-e902c41a7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.335310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-0ae48db0-1a1b-4026-8768-e902c41a7d93 None None] MFA Rules not processed for user `dcb0aae565f84d60a8722c74e83b6682`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:23.336945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0ae48db0-1a1b-4026-8768-e902c41a7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:23.388386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 813/1619] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:23.389291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f9c56-10b4-4837-9da6-401b7ca791ae None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.436342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 807/1620] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:23.437743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae48db0-1a1b-4026-8768-e902c41a7d93 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.476901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f9c56-10b4-4837-9da6-401b7ca791ae None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.489267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.490144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.490668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.492186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.511182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae48db0-1a1b-4026-8768-e902c41a7d93 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.515834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.516600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.517367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.517737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.549852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:23.580353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.581322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:23.583571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.600727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 814/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:23.602213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.613705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558974d5-5460-4c64-95fc-603e9aa081f8 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.617981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.618775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.619222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.619835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.624254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.625886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.630825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.632508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.646461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 815/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:23.647688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.653037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 808/1623] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:23.654968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.661930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430c31a-db1c-4ab4-84fa-b86a8a2a0b92 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.672150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.676245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.676564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.677130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.677882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.680178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572af70-eaaf-4827-9ea8-ebec49dc83b1 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.682214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.693026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521499a-3793-4561-b561-b2285305b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.693942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521499a-3793-4561-b561-b2285305b9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.695114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521499a-3793-4561-b561-b2285305b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.698322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521499a-3793-4561-b561-b2285305b9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.699223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521499a-3793-4561-b561-b2285305b9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.702959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521499a-3793-4561-b561-b2285305b9ee admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.715890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 816/1624] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:23.716753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.731025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df57cc-f9bf-47e8-9893-3d79c78fd7c0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.740762 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.741685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.742311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.742793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.743666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.745824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.772823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 809/1625] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:23.774462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ebd3-ae86-49aa-a22d-ed74c813ba7a None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.775508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ebd3-ae86-49aa-a22d-ed74c813ba7a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.776432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7ebd3-ae86-49aa-a22d-ed74c813ba7a None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.779249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 810/1626] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 17 16:15:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:23.783255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7ebd3-ae86-49aa-a22d-ed74c813ba7a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.788717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 817/1627] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/projects => generated 357 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:23.789933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.915758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d452b-f36e-4aac-9d45-3389f7f1177b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.916104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7ebd3-ae86-49aa-a22d-ed74c813ba7a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.921210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaa1e0-db50-4a78-95a9-d832b3c0c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.922049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa1e0-db50-4a78-95a9-d832b3c0c1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.922335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa1e0-db50-4a78-95a9-d832b3c0c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.922611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaa1e0-db50-4a78-95a9-d832b3c0c1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.923875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaa1e0-db50-4a78-95a9-d832b3c0c1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.925546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:23.925718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaa1e0-db50-4a78-95a9-d832b3c0c1c7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.926724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.927103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.927611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.929930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:23.934382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:23.941848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 811/1628] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:23.943484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5f4a-db80-400c-88a1-d36a04bef3b6 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:23.943714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5f4a-db80-400c-88a1-d36a04bef3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:23.944015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5f4a-db80-400c-88a1-d36a04bef3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:23.972035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 818/1629] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/users => generated 308 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:23.973319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:23.995150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61c485-7c14-4d16-a368-bdd1deadd618 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:23.999039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ef2c5f4a-db80-400c-88a1-d36a04bef3b6 None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:24.000375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ef2c5f4a-db80-400c-88a1-d36a04bef3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:24.002035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.005223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.005223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.005223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.005223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.007081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.050626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 819/1630] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/users => generated 285 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:24.050626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.070524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32558d-0c54-4195-beee-5d2b0795d374 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.083561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.084645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.085004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.085298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] PATH_INFO: `/v3/projects/cbac62f975384765ad4ad83bf2b38206/users/0d9cf91f80a345df839437882e36147f/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.107218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbac62f975384765ad4ad83bf2b38206, user_id=0d9cf91f80a345df839437882e36147f, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.110828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.122135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 812/1631] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 17 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:24.123238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5f4a-db80-400c-88a1-d36a04bef3b6 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.135793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5f4a-db80-400c-88a1-d36a04bef3b6 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.136771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 820/1632] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:24 2022] PUT /identity/v3/projects/cbac62f975384765ad4ad83bf2b38206/users/0d9cf91f80a345df839437882e36147f/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:24.138011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.197278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:24.227118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:24.238860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.239830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.240282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.240919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.241720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.243725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.262858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 813/1633] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:24.262858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.305514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55370ca-3553-4a7b-81d5-221808192f97 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.310506 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.311855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.312227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.312604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.313267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.319736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.336951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 821/1634] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:24.338011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.354385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416c3cb-6d10-403f-9476-d5187164d1bf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.362885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.363668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.364199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.364681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.367007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.368841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.403990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c610f75-0145-4fd5-a5ea-edd9b134c0f3 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.417521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 822/1635] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:24.417770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.418610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.418901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.419179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.420704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.451714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f015a1-34fc-4018-8424-275a9476c426 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.463786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.464614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.464960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.465363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] PATH_INFO: `/v3/projects/f1437fab32eb4925a38bf349ab3581dc/users/99509ecaca0b403580e3651d569edc4e/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.494553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1437fab32eb4925a38bf349ab3581dc, user_id=99509ecaca0b403580e3651d569edc4e, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.498195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.524746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 823/1636] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:24 2022] PUT /identity/v3/projects/f1437fab32eb4925a38bf349ab3581dc/users/99509ecaca0b403580e3651d569edc4e/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:24.529079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.532179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.644130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.644130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 814/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:24.644130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.644130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb244a-ab2c-4456-8aa8-757e02fb02be service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.718890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.720099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.720605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.721058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] PATH_INFO: `/v3/projects/cbac62f975384765ad4ad83bf2b38206/users/0d9cf91f80a345df839437882e36147f/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.724716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c41f-0eb8-4019-928f-a713a7abd223 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.725237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbac62f975384765ad4ad83bf2b38206, user_id=0d9cf91f80a345df839437882e36147f, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.728788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.740916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.742115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.742423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.742683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] PATH_INFO: `/v3/projects/738171ea991940348836ada04ab6ca9f/users/9432a43503d4412484ca4e287a1a7530/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.758460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 815/1638] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:24 2022] PUT /identity/v3/projects/cbac62f975384765ad4ad83bf2b38206/users/0d9cf91f80a345df839437882e36147f/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:24.760034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.765667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:24.784668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] RBAC: Authorizing `identity:create_grant(project_id=738171ea991940348836ada04ab6ca9f, user_id=9432a43503d4412484ca4e287a1a7530, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.790419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.823076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 824/1639] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:24 2022] PUT /identity/v3/projects/738171ea991940348836ada04ab6ca9f/users/9432a43503d4412484ca4e287a1a7530/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:24.827278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:24.852242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d7826-4ad8-407f-bcc2-4565dd529c7f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.928836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.929492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.929768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.930036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] PATH_INFO: `/v3/users/5e73b485d0f14328a085f410488f30a5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.931194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e73b485d0f14328a085f410488f30a5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.933296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:24.977128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590da3-c4d7-44cd-b061-706f4005445b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:24.983161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d01dd1-9e5b-4ecf-9440-6fa122ea49fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:24.984150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01dd1-9e5b-4ecf-9440-6fa122ea49fa admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:24.984652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01dd1-9e5b-4ecf-9440-6fa122ea49fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:24.985103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d01dd1-9e5b-4ecf-9440-6fa122ea49fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:24.986270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d01dd1-9e5b-4ecf-9440-6fa122ea49fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:24.988269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d01dd1-9e5b-4ecf-9440-6fa122ea49fa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:25.000843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 825/1640] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:25.003658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757ecbc-54cb-42b3-b64c-96ff547ea065 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.004161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757ecbc-54cb-42b3-b64c-96ff547ea065 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.004907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757ecbc-54cb-42b3-b64c-96ff547ea065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.011464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e73b485d0f14328a085f410488f30a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:25.012834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e73b485d0f14328a085f410488f30a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:25.014291 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e73b485d0f14328a085f410488f30a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:25.037611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:25.041948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e73b485d0f14328a085f410488f30a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:25.055414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e73b485d0f14328a085f410488f30a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:25.061572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b757ecbc-54cb-42b3-b64c-96ff547ea065 None None] MFA Rules not processed for user `0d9cf91f80a345df839437882e36147f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:25.065335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b757ecbc-54cb-42b3-b64c-96ff547ea065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.087995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 816/1641] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:24 2022] DELETE /identity/v3/users/5e73b485d0f14328a085f410488f30a5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:25.089193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:25.091017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.146200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:25.187340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 826/1642] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:25.190366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff231b1-d057-44c4-95d6-d15ab7d8912a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.190827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff231b1-d057-44c4-95d6-d15ab7d8912a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.191395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff231b1-d057-44c4-95d6-d15ab7d8912a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.193785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d48ee2-741b-464d-b058-7ef10c5b9d8f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:25.198016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 827/1643] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 17 16:15:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:25.198898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff231b1-d057-44c4-95d6-d15ab7d8912a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:25.200926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6ff231b1-d057-44c4-95d6-d15ab7d8912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.201137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e629-4666-4d6a-a5a3-16d845e3842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:25.207150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e629-4666-4d6a-a5a3-16d845e3842a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.207773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e629-4666-4d6a-a5a3-16d845e3842a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.208244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e629-4666-4d6a-a5a3-16d845e3842a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.209093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e629-4666-4d6a-a5a3-16d845e3842a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:25.210909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e629-4666-4d6a-a5a3-16d845e3842a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:25.222807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff231b1-d057-44c4-95d6-d15ab7d8912a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:25.232196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:25.250517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 817/1644] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:25.252493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913474ee-9388-4c38-a023-cc84738b91b2 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.253241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913474ee-9388-4c38-a023-cc84738b91b2 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.253693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913474ee-9388-4c38-a023-cc84738b91b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.253928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.254848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.258307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] PATH_INFO: `/v3/projects/f1437fab32eb4925a38bf349ab3581dc/users/99509ecaca0b403580e3651d569edc4e/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.265741 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1437fab32eb4925a38bf349ab3581dc, user_id=99509ecaca0b403580e3651d569edc4e, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:25.272127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:25.290695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-913474ee-9388-4c38-a023-cc84738b91b2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:25.292312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-913474ee-9388-4c38-a023-cc84738b91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.301803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 818/1645] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:25.307673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a0a4-c973-4ebb-aaca-9bb47ba63dd6 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.308267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a0a4-c973-4ebb-aaca-9bb47ba63dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.308835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27a0a4-c973-4ebb-aaca-9bb47ba63dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.322028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 828/1646] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:25 2022] PUT /identity/v3/projects/f1437fab32eb4925a38bf349ab3581dc/users/99509ecaca0b403580e3651d569edc4e/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:25.322028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:25.324626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.342397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1a27a0a4-c973-4ebb-aaca-9bb47ba63dd6 None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:25.344339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1a27a0a4-c973-4ebb-aaca-9bb47ba63dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.459928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7498fac-5580-400e-8498-6ee1889ca95b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:25.464873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2fc2e-6686-47bb-8c47-f43ee12c507b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:25.465846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2fc2e-6686-47bb-8c47-f43ee12c507b service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.466350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2fc2e-6686-47bb-8c47-f43ee12c507b service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.466780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2fc2e-6686-47bb-8c47-f43ee12c507b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.480329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 819/1647] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:25.481961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a0a4-c973-4ebb-aaca-9bb47ba63dd6 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:25.616612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27a0a4-c973-4ebb-aaca-9bb47ba63dd6 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:25.626692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:25.627661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.628879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2fc2e-6686-47bb-8c47-f43ee12c507b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:25.630126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.630486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] PATH_INFO: `/v3/projects/738171ea991940348836ada04ab6ca9f/users/9432a43503d4412484ca4e287a1a7530/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.632129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2fc2e-6686-47bb-8c47-f43ee12c507b service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:25.636945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738171ea991940348836ada04ab6ca9f, user_id=9432a43503d4412484ca4e287a1a7530, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:25.642709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:25.654549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 829/1648] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:25.660718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.661430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.662382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.680858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 820/1649] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:25 2022] PUT /identity/v3/projects/738171ea991940348836ada04ab6ca9f/users/9432a43503d4412484ca4e287a1a7530/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:25.681229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:25.686171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.745047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] MFA Rules not processed for user `99509ecaca0b403580e3651d569edc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:25.748773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:25.809802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:25.842930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:25.867371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cbb10-7685-4e33-b31a-777341bd2da7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:25.882774 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffede4-b3c9-4f2a-a3cc-046a3dc3431b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:25.884229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffede4-b3c9-4f2a-a3cc-046a3dc3431b service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:25.884514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffede4-b3c9-4f2a-a3cc-046a3dc3431b service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:25.884779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffede4-b3c9-4f2a-a3cc-046a3dc3431b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:25.948011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 830/1650] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:25.951350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:25.956005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:26.038932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffede4-b3c9-4f2a-a3cc-046a3dc3431b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:26.040479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffede4-b3c9-4f2a-a3cc-046a3dc3431b service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:26.067702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 821/1651] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:26.069123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e480bf-8c2b-41c3-adbb-9bcce25a0b07 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:26.069365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e480bf-8c2b-41c3-adbb-9bcce25a0b07 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:26.069643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e480bf-8c2b-41c3-adbb-9bcce25a0b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:26.098546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58a426-0eb8-4f3c-b56b-6a7b5ea6fe93 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:26.105474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-77e480bf-8c2b-41c3-adbb-9bcce25a0b07 None None] MFA Rules not processed for user `9432a43503d4412484ca4e287a1a7530`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:26.106826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-77e480bf-8c2b-41c3-adbb-9bcce25a0b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:26.109210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:26.109976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:26.110363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:26.111291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:26.241918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 822/1652] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:26.249040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e480bf-8c2b-41c3-adbb-9bcce25a0b07 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:26.263067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e480bf-8c2b-41c3-adbb-9bcce25a0b07 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:26.268396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:26.269851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:26.270292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:26.270679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:26.272809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:26.280678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:26.282298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:26.309407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 831/1653] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:26.396749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:26.398401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:26.421487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 823/1654] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:26.886911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:26.901626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eecd4-de62-4c3a-837c-faa5b43718ba service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:26.921384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:26.922023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:26.922302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:26.922575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:26.946351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:26.947830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:26.966074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 832/1655] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:26 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:27.047934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:27.058137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9bfbf-26dd-40ea-95ec-dcf7d1e0eb9f service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:27.072050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:27.072790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:27.073065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:27.073339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:27.112365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:27.113842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:27.140011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 824/1656] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:27.452918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:27.454705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:27.496718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2ba7-fab5-4712-9451-8221a6037ab8 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:27.502328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:27.502980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:27.503257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:27.503531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] PATH_INFO: `/v3/projects/081e95024c5243e8acaa8e0be2d130a9` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:27.510026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=081e95024c5243e8acaa8e0be2d130a9)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:27.512407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:27.606704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:27.623772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081e95024c5243e8acaa8e0be2d130a9', 'request_id': 'req-eea9bf08-0733-41a5-8292-28e14f1adafa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.639563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081e95024c5243e8acaa8e0be2d130a9', 'request_id': 'req-eea9bf08-0733-41a5-8292-28e14f1adafa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.667461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081e95024c5243e8acaa8e0be2d130a9', 'request_id': 'req-eea9bf08-0733-41a5-8292-28e14f1adafa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.695273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] The token cache is being invalidate because project 081e95024c5243e8acaa8e0be2d130a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:27.695599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.699136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.703496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 833/1657] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:27 2022] DELETE /identity/v3/projects/081e95024c5243e8acaa8e0be2d130a9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:27.708095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:27.718093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:27.728763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8b62-8dfd-48ca-97b8-3da57f6deb17 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:27.851575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:27.852487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:27.853345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:27.853345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] PATH_INFO: `/v3/users/34e8642eea3342b5bfb6c51df67bd173` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:27.855368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e8642eea3342b5bfb6c51df67bd173)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:27.857605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:27.945073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e8642eea3342b5bfb6c51df67bd173'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.946030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e8642eea3342b5bfb6c51df67bd173'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.946820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e8642eea3342b5bfb6c51df67bd173'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.978466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e8642eea3342b5bfb6c51df67bd173'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:27.987854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e8642eea3342b5bfb6c51df67bd173'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:28.015483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 825/1658] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:27 2022] DELETE /identity/v3/users/34e8642eea3342b5bfb6c51df67bd173 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:15:28.357485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:28.359204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:28.552224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9bf08-0733-41a5-8292-28e14f1adafa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:28.577695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:28.579243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:28.670717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0daf96-78b9-4c20-b74a-3c98d10574be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:28.670717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0daf96-78b9-4c20-b74a-3c98d10574be service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:28.670717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0daf96-78b9-4c20-b74a-3c98d10574be service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:28.670717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0daf96-78b9-4c20-b74a-3c98d10574be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:28.674021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3a0daf96-78b9-4c20-b74a-3c98d10574be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:28.817835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0daf96-78b9-4c20-b74a-3c98d10574be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:28.822210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0daf96-78b9-4c20-b74a-3c98d10574be service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:28.857497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 834/1659] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:28 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:28.924139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1485d-17a8-4377-9799-fe508425a3e4 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:28.949911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:28.950674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:28.952250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:28.953397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] PATH_INFO: `/v3/users/ccba871c23ef4552a9080767f97c52ba` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:28.959554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccba871c23ef4552a9080767f97c52ba)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:28.962193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:29.053953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d005-4c69-4b60-a548-2a40e1dd666f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.054430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d005-4c69-4b60-a548-2a40e1dd666f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.054860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d005-4c69-4b60-a548-2a40e1dd666f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.057006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 835/1660] 10.222.0.60 () {54 vars in 962 bytes} [Wed Aug 17 16:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:29.064210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95602f6-6a7b-4b3d-bf72-a8282ec00ece None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.064743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95602f6-6a7b-4b3d-bf72-a8282ec00ece None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.065175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95602f6-6a7b-4b3d-bf72-a8282ec00ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.069414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:29.122521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f95602f6-6a7b-4b3d-bf72-a8282ec00ece None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:29.124302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccba871c23ef4552a9080767f97c52ba'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:29.125020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccba871c23ef4552a9080767f97c52ba'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:29.125883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f95602f6-6a7b-4b3d-bf72-a8282ec00ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.127772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccba871c23ef4552a9080767f97c52ba'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:29.157279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccba871c23ef4552a9080767f97c52ba'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:29.188327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8997445a-e4f8-41d3-9ea7-80b4cdec4c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccba871c23ef4552a9080767f97c52ba'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:29.233074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 826/1661] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:28 2022] DELETE /identity/v3/users/ccba871c23ef4552a9080767f97c52ba => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:29.234542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.234856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.235136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.240455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:29.306024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:29.307342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.360154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 836/1662] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Aug 17 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:29.367181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ef55-d994-45c5-ae04-da4ba87b6d6d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.370079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ef55-d994-45c5-ae04-da4ba87b6d6d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.370476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ef55-d994-45c5-ae04-da4ba87b6d6d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.373580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 837/1663] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 17 16:15:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:15:29.381209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.382493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.382990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.419894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:29.422908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.572350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 827/1664] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:29.628973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 838/1665] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:15:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:29.632033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:29.636061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.649725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:29.656711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:29.845455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03a4b8-e3b6-4ae0-bdf9-0d703c7ff3af None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:29.860213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:29.861705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.862903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.863942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.893249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:29.900871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:29.906923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca56f6-4ffa-400e-a700-5e06a949100b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:29.920553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cbe91-fd78-4f41-9d9a-53b3417fff4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:29.921207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cbe91-fd78-4f41-9d9a-53b3417fff4c service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.923828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cbe91-fd78-4f41-9d9a-53b3417fff4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.924078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cbe91-fd78-4f41-9d9a-53b3417fff4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.930260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 828/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:15:29.960804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cbe91-fd78-4f41-9d9a-53b3417fff4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:29.962843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cbe91-fd78-4f41-9d9a-53b3417fff4c service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:29.992481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 839/1667] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:30.381370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:30.383406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:30.415288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6778-91d7-4ef6-887e-1349aa8add38 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:30.449582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:30.450530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:30.452499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:30.453729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] PATH_INFO: `/v3/projects/0cbf47a2439f4a00a0c4d4cb3599cab0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:30.457051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbf47a2439f4a00a0c4d4cb3599cab0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:30.462310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: WARNING py.warnings [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:15:30.462310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: warnings.warn(msg) Aug 17 16:15:30.462310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: Aug 17 16:15:30.466261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:30.602988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:30.629491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbf47a2439f4a00a0c4d4cb3599cab0', 'request_id': 'req-4d562da3-cb1f-488d-a54c-d2310d67fb06'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:30.648785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbf47a2439f4a00a0c4d4cb3599cab0', 'request_id': 'req-4d562da3-cb1f-488d-a54c-d2310d67fb06'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:30.676132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbf47a2439f4a00a0c4d4cb3599cab0', 'request_id': 'req-4d562da3-cb1f-488d-a54c-d2310d67fb06'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:30.727746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] The token cache is being invalidate because project 0cbf47a2439f4a00a0c4d4cb3599cab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:30.729547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:30.731023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-4d562da3-cb1f-488d-a54c-d2310d67fb06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:30.736206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 829/1668] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:30 2022] DELETE /identity/v3/projects/0cbf47a2439f4a00a0c4d4cb3599cab0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:30.741273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6ed1-bfae-4c28-a44f-19bc485b2b99 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:30.742213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6ed1-bfae-4c28-a44f-19bc485b2b99 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:30.743031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6ed1-bfae-4c28-a44f-19bc485b2b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:30.807279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c1bc6ed1-bfae-4c28-a44f-19bc485b2b99 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:30.809623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c1bc6ed1-bfae-4c28-a44f-19bc485b2b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:31.069837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 840/1669] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:31.077705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8853-86a4-418d-8057-13438cf0df0c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.078265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8853-86a4-418d-8057-13438cf0df0c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.078467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8853-86a4-418d-8057-13438cf0df0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.124777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-477a8853-86a4-418d-8057-13438cf0df0c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:31.128795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-477a8853-86a4-418d-8057-13438cf0df0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:31.155971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc6ed1-bfae-4c28-a44f-19bc485b2b99 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:31.156305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 830/1670] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:31.165562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:31.173697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc6ed1-bfae-4c28-a44f-19bc485b2b99 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:31.193459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:31.194442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.194893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.195333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.196360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:31.196799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:31.199328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:31.221311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 841/1671] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:15:31.228525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8853-86a4-418d-8057-13438cf0df0c None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:31.239666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8853-86a4-418d-8057-13438cf0df0c None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:31.246000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:31.246626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.246975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.247307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.252878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:31.255621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:31.356702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 831/1672] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:31 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:31.362175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:31.380632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbf301-ccd0-43f7-81a9-ec71bdc86678 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:31.520912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:31.522288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.522726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.523117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.523959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:31.526475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:31.566806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 842/1673] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:31 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:31.571730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:31.585028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176862c-d8da-4e80-b1ce-b61403584b4f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:31.592505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:31.594040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.594425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.594853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.595620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:31.607583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:31.631440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 832/1674] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:15:31.635228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:31.655480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a10e9b-9821-4c7f-bc02-a513ded1a660 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:31.661383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a75292-a465-4bbd-a6f3-fb22e9c3ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:31.662091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a75292-a465-4bbd-a6f3-fb22e9c3ba2f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.662460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a75292-a465-4bbd-a6f3-fb22e9c3ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.662699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a75292-a465-4bbd-a6f3-fb22e9c3ba2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.663474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a75292-a465-4bbd-a6f3-fb22e9c3ba2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:31.665993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a75292-a465-4bbd-a6f3-fb22e9c3ba2f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:31.679542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 843/1675] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:31.684262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:31.712237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff196845-a920-4f78-890a-ebdf73b548de admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:31.720644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25156b9d-2215-4fa6-8567-e4ded7590314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:31.723841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156b9d-2215-4fa6-8567-e4ded7590314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.724262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156b9d-2215-4fa6-8567-e4ded7590314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.724557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25156b9d-2215-4fa6-8567-e4ded7590314 admin admin] PATH_INFO: `/v3/projects/431fdd69ff9a4348b07da7eee17ab886/users/af158fe3c5fe42df9ca2ec2cee039d26/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.748800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156b9d-2215-4fa6-8567-e4ded7590314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431fdd69ff9a4348b07da7eee17ab886, user_id=af158fe3c5fe42df9ca2ec2cee039d26, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:31.752459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25156b9d-2215-4fa6-8567-e4ded7590314 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:31.790457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 833/1676] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:31 2022] PUT /identity/v3/projects/431fdd69ff9a4348b07da7eee17ab886/users/af158fe3c5fe42df9ca2ec2cee039d26/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:31.794200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3d902-0933-47f8-befa-564f7c14f30c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.794658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3d902-0933-47f8-befa-564f7c14f30c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.795033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3d902-0933-47f8-befa-564f7c14f30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:31.855091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-eae3d902-0933-47f8-befa-564f7c14f30c None None] MFA Rules not processed for user `af158fe3c5fe42df9ca2ec2cee039d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:31.856614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eae3d902-0933-47f8-befa-564f7c14f30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:31.953010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:31.953330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:31.953758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.036056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] MFA Rules not processed for user `d8f2a3a6a0bc461d9e7ba14c8a037b59`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:32.037480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.062413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 844/1677] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:32.063511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3d902-0933-47f8-befa-564f7c14f30c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:32.230873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 834/1678] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:32.230873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:32.230873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.273901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3d902-0933-47f8-befa-564f7c14f30c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:32.303743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b04c7e-edbd-45aa-87de-a0f451cb1817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:32.304106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04c7e-edbd-45aa-87de-a0f451cb1817 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.304471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04c7e-edbd-45aa-87de-a0f451cb1817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.304756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b04c7e-edbd-45aa-87de-a0f451cb1817 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.305476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04c7e-edbd-45aa-87de-a0f451cb1817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:32.326794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b04c7e-edbd-45aa-87de-a0f451cb1817 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:32.329377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bab7d-f29d-4f45-a88e-944e3f377147 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:32.340965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:32.345433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:32.346463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.346463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.346733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] PATH_INFO: `/v3/users/dcb0aae565f84d60a8722c74e83b6682` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.356557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb0aae565f84d60a8722c74e83b6682)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:32.376869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:32.430997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 845/1679] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:32 2022] POST /identity/v3/projects => generated 379 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:32.432492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.432761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.433034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.507452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] MFA Rules not processed for user `d8f2a3a6a0bc461d9e7ba14c8a037b59`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:32.510051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.517907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb0aae565f84d60a8722c74e83b6682'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:32.520301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb0aae565f84d60a8722c74e83b6682'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:32.523674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb0aae565f84d60a8722c74e83b6682'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:32.528374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:32.553687 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb0aae565f84d60a8722c74e83b6682'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:32.571469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb0aae565f84d60a8722c74e83b6682'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:32.602751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 835/1680] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:32 2022] DELETE /identity/v3/users/dcb0aae565f84d60a8722c74e83b6682 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:32.604170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:32.605395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.658984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 846/1681] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:32.658984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:32.662134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:32.772769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35153534-f5e7-4402-8520-4c08aa2c5314 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:32.784641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:32.785548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.785995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.786414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] PATH_INFO: `/v3/projects/ada4e13b032f47708b4fe19f5a61ef1d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.795912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada4e13b032f47708b4fe19f5a61ef1d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:32.798431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:32.846116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcd1e-cb21-4e7b-9117-8bbc20643903 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:32.855961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d945a03-7e40-462b-b720-1698956f1c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:32.857551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d945a03-7e40-462b-b720-1698956f1c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.857997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d945a03-7e40-462b-b720-1698956f1c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.858418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d945a03-7e40-462b-b720-1698956f1c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.859765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d945a03-7e40-462b-b720-1698956f1c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:32.867692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d945a03-7e40-462b-b720-1698956f1c3b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:32.918280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 847/1682] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:32 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:32.923386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:32.923954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:32.924849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:32.933746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada4e13b032f47708b4fe19f5a61ef1d', 'request_id': 'req-9d28c186-1741-4be1-93dd-6669d9e358a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:32.958599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada4e13b032f47708b4fe19f5a61ef1d', 'request_id': 'req-9d28c186-1741-4be1-93dd-6669d9e358a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.002082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada4e13b032f47708b4fe19f5a61ef1d', 'request_id': 'req-9d28c186-1741-4be1-93dd-6669d9e358a5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.019772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:33.027766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.055490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] The token cache is being invalidate because project ada4e13b032f47708b4fe19f5a61ef1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:33.057890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.066097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.075045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 836/1683] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:32 2022] DELETE /identity/v3/projects/ada4e13b032f47708b4fe19f5a61ef1d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:33.076184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:33.086631 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.265633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 848/1684] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:33.266718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:33.268417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.287108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81426e5b-4c77-4d9e-ab12-9cb518d28e5a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:33.293480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:33.294946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.296070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:33.297241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.297425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.298409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:33.301924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:33.337519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 849/1685] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:33.338941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:33.344219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.366513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c0883-a152-42f2-a394-ff7b582cf161 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:33.369735 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28c186-1741-4be1-93dd-6669d9e358a5 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:33.374231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:33.376625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.376817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.379222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] PATH_INFO: `/v3/users/99509ecaca0b403580e3651d569edc4e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.382422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99509ecaca0b403580e3651d569edc4e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:33.383649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: WARNING py.warnings [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:15:33.383649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: warnings.warn(msg) Aug 17 16:15:33.383649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: Aug 17 16:15:33.384892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:33.385333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.385618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.385897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.386205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:33.389343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:33.391015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.512917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99509ecaca0b403580e3651d569edc4e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.525681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99509ecaca0b403580e3651d569edc4e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.526421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99509ecaca0b403580e3651d569edc4e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.533166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:33.534806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:33.548248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99509ecaca0b403580e3651d569edc4e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.556983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 837/1686] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:33.557839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:33.561438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.564487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99509ecaca0b403580e3651d569edc4e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:33.576266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 850/1687] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:33 2022] DELETE /identity/v3/users/99509ecaca0b403580e3651d569edc4e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:33.577156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:33.585956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.715900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcb3af-20ac-48ea-91c4-2b7761cc5d8a service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:33.777543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be0501-660a-4b27-b1e2-bf70403c4ae4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:33.794936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:33.795837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.802255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.802650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.803384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:33.805102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:33.827931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 851/1688] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:33.830359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:33.870496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f022b6-5183-47ac-8bc8-3bc685cd6983 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:33.874662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:33.875306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.875591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.875927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.876812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77acba2-02d6-4fe7-abf4-00e3480c7fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:33.877269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77acba2-02d6-4fe7-abf4-00e3480c7fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.877557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77acba2-02d6-4fe7-abf4-00e3480c7fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.877890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77acba2-02d6-4fe7-abf4-00e3480c7fd8 admin admin] PATH_INFO: `/v3/projects/f5b8d416045f46d79e5063975e81b1af/users/df2cc47ef0d344479afe1d27a7be61be/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.878108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.896556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77acba2-02d6-4fe7-abf4-00e3480c7fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b8d416045f46d79e5063975e81b1af, user_id=df2cc47ef0d344479afe1d27a7be61be, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:33.899719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77acba2-02d6-4fe7-abf4-00e3480c7fd8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:33.910430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:33.912195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:33.928609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 852/1689] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:33 2022] PUT /identity/v3/projects/f5b8d416045f46d79e5063975e81b1af/users/df2cc47ef0d344479afe1d27a7be61be/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:33.938536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 838/1690] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:33.938805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dbdd5-8881-417b-96f6-42f294927fd5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.939100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dbdd5-8881-417b-96f6-42f294927fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.939511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dbdd5-8881-417b-96f6-42f294927fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.998269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-eb0dbdd5-8881-417b-96f6-42f294927fd5 None None] MFA Rules not processed for user `df2cc47ef0d344479afe1d27a7be61be`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:33.999557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eb0dbdd5-8881-417b-96f6-42f294927fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:34.077085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:34.133399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 853/1691] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:34.137466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:34.149131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b475a7-5f7a-4665-93e0-a77cfca30b3c service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:34.268551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:34.294306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:34.294306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:34.300249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:34.300992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:34.301843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:34.303930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:34.380954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 839/1692] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:34 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:34.382314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dbdd5-8881-417b-96f6-42f294927fd5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:34.399904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dbdd5-8881-417b-96f6-42f294927fd5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:34.519753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:34.520626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:34.520938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:34.521210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:34.521923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:34.524118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:34.578451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 854/1693] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:34 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:34.583198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:34.598945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72602c-34e9-45cd-929a-4228a4fe2df1 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:34.612043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092ed95-2c4a-4ec3-8b87-1ed5b9f5aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:34.612767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092ed95-2c4a-4ec3-8b87-1ed5b9f5aa90 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:34.613072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092ed95-2c4a-4ec3-8b87-1ed5b9f5aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:34.613339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092ed95-2c4a-4ec3-8b87-1ed5b9f5aa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:34.615708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092ed95-2c4a-4ec3-8b87-1ed5b9f5aa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:34.619456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092ed95-2c4a-4ec3-8b87-1ed5b9f5aa90 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:34.647184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 840/1694] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:34.651829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:34.670420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375d9d-f94f-40f6-8080-c0601699aa99 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:34.682035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:34.682818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:34.684751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:34.685100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] PATH_INFO: `/v3/projects/4cb0466622184f21bf9f487296968b04/users/1a5a0e827a09492c9a3f10baebc9edd2/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:34.710399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcf31-6ade-4f7c-85cb-76d7fe4eb728 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:34.711099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcf31-6ade-4f7c-85cb-76d7fe4eb728 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:34.711527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbcf31-6ade-4f7c-85cb-76d7fe4eb728 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:34.715106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 841/1695] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 17 16:15:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:34.721559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:34.722132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:34.722584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:34.726348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb0466622184f21bf9f487296968b04, user_id=1a5a0e827a09492c9a3f10baebc9edd2, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:34.730408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:34.781618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 855/1696] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:34 2022] PUT /identity/v3/projects/4cb0466622184f21bf9f487296968b04/users/1a5a0e827a09492c9a3f10baebc9edd2/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:34.788547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:34.790497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] MFA Rules not processed for user `13729a757e1a4f95a957fedb84705960`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:34.792643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:34.943621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 842/1697] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:15:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:34.968975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:34.972320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:34.998372 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac9dac-7c7c-4ba7-9546-a227777ff475 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.003706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.004780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.005222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.005603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.027101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:35.029098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:35.042255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 843/1698] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:35.043431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:35.044070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f86d97-faef-4ca9-b291-6fd078c4b317 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.045361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:35.058341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.059222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.059826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.060742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.061655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:35.067338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:35.077885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0d37-287f-4fab-8dd7-75254e32c22b service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.086948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.088042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.088510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.089489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] PATH_INFO: `/v3/projects/f1437fab32eb4925a38bf349ab3581dc` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.092107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1437fab32eb4925a38bf349ab3581dc)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:35.098479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:35.104073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 856/1699] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:35.106661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:35.125595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a078902-17a1-45e2-a0bb-6f05e7066172 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.146161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e52d1a-7b28-4944-8b98-1aad763a9b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.146852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e52d1a-7b28-4944-8b98-1aad763a9b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.147134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e52d1a-7b28-4944-8b98-1aad763a9b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.147411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e52d1a-7b28-4944-8b98-1aad763a9b97 admin admin] PATH_INFO: `/v3/projects/4cb0466622184f21bf9f487296968b04/users/1a5a0e827a09492c9a3f10baebc9edd2/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.149530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e52d1a-7b28-4944-8b98-1aad763a9b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb0466622184f21bf9f487296968b04, user_id=1a5a0e827a09492c9a3f10baebc9edd2, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:35.152278 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e52d1a-7b28-4944-8b98-1aad763a9b97 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:35.192642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 857/1700] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:35 2022] PUT /identity/v3/projects/4cb0466622184f21bf9f487296968b04/users/1a5a0e827a09492c9a3f10baebc9edd2/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:35.196878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.197169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.197449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.223855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1437fab32eb4925a38bf349ab3581dc', 'request_id': 'req-a1da3352-138e-4c2b-bf41-5acb98271e21'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:35.235378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1437fab32eb4925a38bf349ab3581dc', 'request_id': 'req-a1da3352-138e-4c2b-bf41-5acb98271e21'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:35.264285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] MFA Rules not processed for user `1a5a0e827a09492c9a3f10baebc9edd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:35.265891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:35.280767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1437fab32eb4925a38bf349ab3581dc', 'request_id': 'req-a1da3352-138e-4c2b-bf41-5acb98271e21'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:35.293000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:35.311062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] The token cache is being invalidate because project f1437fab32eb4925a38bf349ab3581dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:35.312117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:35.312974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a1da3352-138e-4c2b-bf41-5acb98271e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:35.320780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 844/1701] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:35 2022] DELETE /identity/v3/projects/f1437fab32eb4925a38bf349ab3581dc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:35.324460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c6f86-750d-402a-944b-c5982d1082b5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.324759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c6f86-750d-402a-944b-c5982d1082b5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.325032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c6f86-750d-402a-944b-c5982d1082b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.355205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6f2c6f86-750d-402a-944b-c5982d1082b5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:35.358024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6f2c6f86-750d-402a-944b-c5982d1082b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:35.435999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 858/1702] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:35.457483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:35.518244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:35.519844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:35.556921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 845/1703] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:35.566349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7689d-91fb-460c-96b9-f078144aae30 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.566628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7689d-91fb-460c-96b9-f078144aae30 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.570229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7689d-91fb-460c-96b9-f078144aae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.657912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-51c7689d-91fb-460c-96b9-f078144aae30 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:35.661874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-51c7689d-91fb-460c-96b9-f078144aae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:35.688952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 846/1704] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:35.692817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7689d-91fb-460c-96b9-f078144aae30 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:35.695152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ecf46-ab2d-4da2-8cbb-a400205b2d95 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.710500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.711139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.711421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.711694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.712553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7689d-91fb-460c-96b9-f078144aae30 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.732256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.732908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.736805 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.737935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.737935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:35.738123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:35.742796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:35.749324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:35.751265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:35.787958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 847/1705] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:35.792000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:35.798603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 859/1706] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:35.812342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4449b6f-2f70-47b1-9f95-328b1ab788ba admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.830755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.831371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.831651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.831952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.832731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:35.835292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:35.890473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:35.902405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2b7a-38a0-4266-bc87-17c3e0cc581d service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:35.917677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc3d48-a124-43cc-87dc-a41ece825b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:35.918553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3d48-a124-43cc-87dc-a41ece825b3d service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:35.919015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3d48-a124-43cc-87dc-a41ece825b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:35.919497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc3d48-a124-43cc-87dc-a41ece825b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:35.920222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 848/1707] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:35 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:35.922141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f1fc3d48-a124-43cc-87dc-a41ece825b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:35.924940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:36.044545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3d48-a124-43cc-87dc-a41ece825b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:36.046128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc3d48-a124-43cc-87dc-a41ece825b3d service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:36.069434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0a6a0-58eb-4117-affb-2c95e7f6ebc6 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:36.075045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:36.075553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.075856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.076136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.078300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:36.083681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:36.101300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 860/1708] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:15:36.133464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df869c21-1470-4a63-b920-31dfbeade263 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.133909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df869c21-1470-4a63-b920-31dfbeade263 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.134495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df869c21-1470-4a63-b920-31dfbeade263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.163139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 849/1709] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:35 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:15:36.167603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:36.208131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9c3b7-e5d6-4cd1-9fd5-9448b2e237eb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:36.215072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:36.215925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.216659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.216659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.217430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:36.221875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:36.235022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 850/1710] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:36.238767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:36.242863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:36.246458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-df869c21-1470-4a63-b920-31dfbeade263 None None] MFA Rules not processed for user `79729883ac964badae04665e547634da`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:36.248207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-df869c21-1470-4a63-b920-31dfbeade263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:36.298953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ef7cb-d980-442a-8981-8e3b57fc27e7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:36.315316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:36.316013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.316276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.316553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] PATH_INFO: `/v3/projects/694ac81eb96c46bf9c999a09e34fb496` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.319445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694ac81eb96c46bf9c999a09e34fb496)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:36.321614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:36.395870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:36.446105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694ac81eb96c46bf9c999a09e34fb496', 'request_id': 'req-c77f9515-fac2-406d-8ce9-194570308ba7'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:36.460206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694ac81eb96c46bf9c999a09e34fb496', 'request_id': 'req-c77f9515-fac2-406d-8ce9-194570308ba7'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:36.465054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 861/1711] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:36.465940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df869c21-1470-4a63-b920-31dfbeade263 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:36.480092 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694ac81eb96c46bf9c999a09e34fb496', 'request_id': 'req-c77f9515-fac2-406d-8ce9-194570308ba7'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:36.481525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:36.504829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] The token cache is being invalidate because project 694ac81eb96c46bf9c999a09e34fb496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:36.505897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:36.507234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:36.509288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 851/1712] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:36 2022] DELETE /identity/v3/projects/694ac81eb96c46bf9c999a09e34fb496 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:36.509957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:36.514555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:36.532741 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df869c21-1470-4a63-b920-31dfbeade263 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:36.715987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f9515-fac2-406d-8ce9-194570308ba7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:36.725161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:36.726318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.726611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.727030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.729571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:36.808283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301394fd-23de-429a-9f03-1efdee451839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:36.810407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301394fd-23de-429a-9f03-1efdee451839 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.811614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301394fd-23de-429a-9f03-1efdee451839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.812774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301394fd-23de-429a-9f03-1efdee451839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.819599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301394fd-23de-429a-9f03-1efdee451839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:36.821397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301394fd-23de-429a-9f03-1efdee451839 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:36.874637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 862/1713] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:36.877220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b54256-ca83-4a20-9c4e-1d9f40290232 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:36.879010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b54256-ca83-4a20-9c4e-1d9f40290232 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:36.879483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b54256-ca83-4a20-9c4e-1d9f40290232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:36.963254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:36.966843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:36.998728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 852/1714] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:36.999869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-43b54256-ca83-4a20-9c4e-1d9f40290232 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:37.003525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:37.008599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:37.008955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-43b54256-ca83-4a20-9c4e-1d9f40290232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:37.083248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 863/1715] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:37.086463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3445e5-3fb5-45ac-b01b-4fc28f447de8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.086899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3445e5-3fb5-45ac-b01b-4fc28f447de8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.087309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3445e5-3fb5-45ac-b01b-4fc28f447de8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.089098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 864/1716] 10.222.0.60 () {54 vars in 961 bytes} [Wed Aug 17 16:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:37.090271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419beed3-43db-4fc6-a01c-d83a7013f1bb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.090973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419beed3-43db-4fc6-a01c-d83a7013f1bb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.102439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bd43b-dbc3-4222-a822-304871a10008 service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:37.117954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419beed3-43db-4fc6-a01c-d83a7013f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.124040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dfed2-d71d-4f99-8e4a-dbe7f15cbe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:37.124769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfed2-d71d-4f99-8e4a-dbe7f15cbe70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.125053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfed2-d71d-4f99-8e4a-dbe7f15cbe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.125335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfed2-d71d-4f99-8e4a-dbe7f15cbe70 admin admin] PATH_INFO: `/v3/projects/5ff9acd3c0ea42f8b673964ce6b1c618/users/d4ad19e9e4d8457186f3527bbb236a3b/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.176458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dfed2-d71d-4f99-8e4a-dbe7f15cbe70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff9acd3c0ea42f8b673964ce6b1c618, user_id=d4ad19e9e4d8457186f3527bbb236a3b, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:37.182286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dfed2-d71d-4f99-8e4a-dbe7f15cbe70 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:37.231405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 853/1717] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:36 2022] PUT /identity/v3/projects/5ff9acd3c0ea42f8b673964ce6b1c618/users/d4ad19e9e4d8457186f3527bbb236a3b/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:37.233652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1267e-c5d5-46dd-84eb-5160aaa5c891 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.233948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1267e-c5d5-46dd-84eb-5160aaa5c891 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.234227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1267e-c5d5-46dd-84eb-5160aaa5c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.243247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-419beed3-43db-4fc6-a01c-d83a7013f1bb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:37.244780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-419beed3-43db-4fc6-a01c-d83a7013f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:37.303386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9bb1267e-c5d5-46dd-84eb-5160aaa5c891 None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:37.311658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9bb1267e-c5d5-46dd-84eb-5160aaa5c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:37.498016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 854/1718] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Aug 17 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:37.512128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98cca2-b0be-40e3-8c96-ccd3e7244007 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.512463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98cca2-b0be-40e3-8c96-ccd3e7244007 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.513976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98cca2-b0be-40e3-8c96-ccd3e7244007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.523268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 865/1719] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:37.524868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419beed3-43db-4fc6-a01c-d83a7013f1bb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:37.541492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:37.571423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419beed3-43db-4fc6-a01c-d83a7013f1bb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:37.604142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:37.607063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.607344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.607764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.615527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:37.639402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-8f98cca2-b0be-40e3-8c96-ccd3e7244007 None None] MFA Rules not processed for user `d4ad19e9e4d8457186f3527bbb236a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:37.648550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:37.650174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:37.650519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8f98cca2-b0be-40e3-8c96-ccd3e7244007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:37.673557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 866/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:37.675359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:37.692622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ad0c6-7ce8-4a22-9b63-c62271f6515e service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:37.699038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:37.699613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.699945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.700414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.701157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:37.701460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:37.703647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:37.719899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 867/1721] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:37.725062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:37.762077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfbcd7-0556-4c5c-a289-ecbff5677fd0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:37.774876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e94e7-8b2f-4711-bc63-335c0e4d8844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:37.777151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e94e7-8b2f-4711-bc63-335c0e4d8844 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.779074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e94e7-8b2f-4711-bc63-335c0e4d8844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.780734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e94e7-8b2f-4711-bc63-335c0e4d8844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.781928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e94e7-8b2f-4711-bc63-335c0e4d8844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:37.790692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e94e7-8b2f-4711-bc63-335c0e4d8844 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:37.872604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 868/1722] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:37 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:37.875135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3633e-aa6e-44cc-9387-7d60f7f89a92 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:37.876726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3633e-aa6e-44cc-9387-7d60f7f89a92 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:37.877140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3633e-aa6e-44cc-9387-7d60f7f89a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:37.897380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 855/1723] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:37.900456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98cca2-b0be-40e3-8c96-ccd3e7244007 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:37.931107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98cca2-b0be-40e3-8c96-ccd3e7244007 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.000138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4bc3633e-aa6e-44cc-9387-7d60f7f89a92 None None] MFA Rules not processed for user `9fe81a429dee4fba8708445dcefa293e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:38.001618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4bc3633e-aa6e-44cc-9387-7d60f7f89a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:38.098332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:38.137419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.138562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.139124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.139596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.141134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:38.147290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:38.189794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 856/1724] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:37 2022] POST /identity/v3/users => generated 287 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:38.191056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:38.213785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9a94-0dff-405a-bf91-10f0a7f0e266 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.223851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.224799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.225126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.225665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.226494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:38.229037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:38.239061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 869/1725] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:38.239061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3633e-aa6e-44cc-9387-7d60f7f89a92 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:38.259195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3633e-aa6e-44cc-9387-7d60f7f89a92 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.272678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c64ef9-46f1-4760-9508-2c5e5b9207ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.273449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64ef9-46f1-4760-9508-2c5e5b9207ec admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.273734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64ef9-46f1-4760-9508-2c5e5b9207ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.274107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c64ef9-46f1-4760-9508-2c5e5b9207ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.275047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c64ef9-46f1-4760-9508-2c5e5b9207ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:38.276890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c64ef9-46f1-4760-9508-2c5e5b9207ec admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:38.305886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 870/1726] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:38.307194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5bfb-ead8-44d5-9860-5fe893432af3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.307496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5bfb-ead8-44d5-9860-5fe893432af3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.307840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a5bfb-ead8-44d5-9860-5fe893432af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.311886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 857/1727] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:38 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:38.313611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:38.373094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a29a5bfb-ead8-44d5-9860-5fe893432af3 None None] MFA Rules not processed for user `9fe81a429dee4fba8708445dcefa293e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:38.380533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a29a5bfb-ead8-44d5-9860-5fe893432af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:38.520698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b013c9e-a1bb-4e2b-aef9-97349bee9946 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.538159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.538798 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.539079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.539353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.541929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:38.543597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:38.545317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:38.560088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 858/1728] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:38.561067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:38.567534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 871/1729] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:38.568695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5bfb-ead8-44d5-9860-5fe893432af3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:38.573080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701384fb-8d1a-48d6-977e-e1848268a643 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.578555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.579265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.579789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.580266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.581002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:38.583171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:38.583281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a5bfb-ead8-44d5-9860-5fe893432af3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.589791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.590588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.590976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.591366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] PATH_INFO: `/v3/projects/cdee27d214584dc49ec22e05d6b9af52/users/8ed50744091a490a9b01f7cfe5f60f24/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.615482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 859/1730] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:38 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:38.616658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:38.624969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdee27d214584dc49ec22e05d6b9af52, user_id=8ed50744091a490a9b01f7cfe5f60f24, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:38.631129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:38.659766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 872/1731] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:38 2022] PUT /identity/v3/projects/cdee27d214584dc49ec22e05d6b9af52/users/8ed50744091a490a9b01f7cfe5f60f24/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:38.661234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:38.804649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972523dc-94e4-4f8a-a44e-1956edc33fb7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.849014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a44af-6eb1-4d05-9e14-5666009f701c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:38.863398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e629ce5-5cf4-419e-946f-c636e8d3f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.864471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e629ce5-5cf4-419e-946f-c636e8d3f634 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.864934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e629ce5-5cf4-419e-946f-c636e8d3f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.865216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e629ce5-5cf4-419e-946f-c636e8d3f634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.865877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e629ce5-5cf4-419e-946f-c636e8d3f634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:38.867497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e629ce5-5cf4-419e-946f-c636e8d3f634 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:38.889961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 873/1732] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:38.890354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e75af-2aa4-4133-bf32-df6815afac56 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.890649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e75af-2aa4-4133-bf32-df6815afac56 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.891100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e75af-2aa4-4133-bf32-df6815afac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.963880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-793e75af-2aa4-4133-bf32-df6815afac56 None None] MFA Rules not processed for user `8ed50744091a490a9b01f7cfe5f60f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:38.968672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:38.969068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-793e75af-2aa4-4133-bf32-df6815afac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:38.969355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:38.969658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:38.970026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:38.997293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:39.143493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:39.145346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:39.173293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 874/1733] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:39.173757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 860/1734] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:39.174458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:39.185818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e75af-2aa4-4133-bf32-df6815afac56 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:39.210835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10b15a-b09d-4f7a-a702-e602e6c6aa0b service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:39.224514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e75af-2aa4-4133-bf32-df6815afac56 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:39.247461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:39.247678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:39.248202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.248372 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.248468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.248548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.248749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] PATH_INFO: `/v3/projects/27c9db653f8a41a999a078a96a3ee5a9/users/6a58e2fccb614dc495ed11e915ee0c60/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.248849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.249494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:39.252470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:39.287335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:39.307108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c9db653f8a41a999a078a96a3ee5a9, user_id=6a58e2fccb614dc495ed11e915ee0c60, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:39.321038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 861/1735] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:39 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:39.325930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:39.334939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:39.361827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 875/1736] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:39 2022] PUT /identity/v3/projects/27c9db653f8a41a999a078a96a3ee5a9/users/6a58e2fccb614dc495ed11e915ee0c60/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:39.362822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:39.454354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d73734-f4dd-4eaf-9516-704bdee2c37b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:39.597798 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:39.598500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.598820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.599702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.602614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:39.632210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:39.647891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b18ba-5d63-4271-946d-4e3021126636 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:39.659726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:39.661660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.661976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.663540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.666455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:39.689328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:39.701076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 862/1737] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:39 2022] POST /identity/v3/users => generated 292 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:15:39.702266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:39.712033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 876/1738] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:39.713470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:39.729731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a08ba-58bc-44b6-8116-552229b03f9d admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:39.741686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04202fc1-1ec7-43ee-81a9-9029e5581fd6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:39.744489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:39.745130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.745973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.746252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.746921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:39.752576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e206233-ea0b-4ade-8cd6-651875fb3939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:39.753329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206233-ea0b-4ade-8cd6-651875fb3939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.753614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206233-ea0b-4ade-8cd6-651875fb3939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.753892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e206233-ea0b-4ade-8cd6-651875fb3939 admin admin] PATH_INFO: `/v3/projects/27c9db653f8a41a999a078a96a3ee5a9/users/6a58e2fccb614dc495ed11e915ee0c60/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.755151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:39.760773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e206233-ea0b-4ade-8cd6-651875fb3939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c9db653f8a41a999a078a96a3ee5a9, user_id=6a58e2fccb614dc495ed11e915ee0c60, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:39.775617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e206233-ea0b-4ade-8cd6-651875fb3939 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:39.783252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 863/1739] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:39.787836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:39.796913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 877/1740] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:39 2022] PUT /identity/v3/projects/27c9db653f8a41a999a078a96a3ee5a9/users/6a58e2fccb614dc495ed11e915ee0c60/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:39.812978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.816046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.817164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a977143-8f0e-46bf-9983-87c828658760 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:39.818247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:39.921906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] MFA Rules not processed for user `6a58e2fccb614dc495ed11e915ee0c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:39.923880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:39.961449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:39.962147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:39.962425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:39.962702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] PATH_INFO: `/v3/projects/fd92f55415c447cc9d1565ad7faedded/users/4eaa14ac2668498bbae8bd014b2d2c0e/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.002260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd92f55415c447cc9d1565ad7faedded, user_id=4eaa14ac2668498bbae8bd014b2d2c0e, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:40.018630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:40.046523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:40.059554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 864/1741] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:39 2022] PUT /identity/v3/projects/fd92f55415c447cc9d1565ad7faedded/users/4eaa14ac2668498bbae8bd014b2d2c0e/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:40.064439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:40.119547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:40.157518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 878/1742] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:40.166800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:40.169110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:40.239674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c325d7-7c0b-4827-bc6d-0d47fc54b679 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:40.253415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7710f-9654-40eb-b39d-20a139530c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:40.254059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7710f-9654-40eb-b39d-20a139530c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.254344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7710f-9654-40eb-b39d-20a139530c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.254621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7710f-9654-40eb-b39d-20a139530c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.255295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7710f-9654-40eb-b39d-20a139530c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:40.257087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7710f-9654-40eb-b39d-20a139530c30 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:40.270824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 865/1743] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:15:40.272254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33ec3f-347b-4be2-83a8-0f4ffd57bdbf None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.272541 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33ec3f-347b-4be2-83a8-0f4ffd57bdbf None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.272819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33ec3f-347b-4be2-83a8-0f4ffd57bdbf None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.274335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 866/1744] 10.222.0.60 () {54 vars in 912 bytes} [Wed Aug 17 16:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:40.275052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33ec3f-347b-4be2-83a8-0f4ffd57bdbf None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:40.296006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc529-7518-4d25-a3d8-e93fd7ac96f6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:40.309347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33ec3f-347b-4be2-83a8-0f4ffd57bdbf None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:40.320880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e4cc8-6e31-4607-a87e-b0d5461bab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:40.325872 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4cc8-6e31-4607-a87e-b0d5461bab11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.327970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4cc8-6e31-4607-a87e-b0d5461bab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.327970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4cc8-6e31-4607-a87e-b0d5461bab11 admin admin] PATH_INFO: `/v3/projects/fd92f55415c447cc9d1565ad7faedded/users/4eaa14ac2668498bbae8bd014b2d2c0e/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.333161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e4cc8-6e31-4607-a87e-b0d5461bab11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd92f55415c447cc9d1565ad7faedded, user_id=4eaa14ac2668498bbae8bd014b2d2c0e, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:40.339556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e4cc8-6e31-4607-a87e-b0d5461bab11 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:40.380376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 867/1745] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:40 2022] PUT /identity/v3/projects/fd92f55415c447cc9d1565ad7faedded/users/4eaa14ac2668498bbae8bd014b2d2c0e/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:40.380376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ccf3-a999-42ee-a706-9fda2a46988f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.380376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ccf3-a999-42ee-a706-9fda2a46988f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.380376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95ccf3-a999-42ee-a706-9fda2a46988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.385618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:40.386751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.387114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.387466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.416114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ad95ccf3-a999-42ee-a706-9fda2a46988f None None] MFA Rules not processed for user `13729a757e1a4f95a957fedb84705960`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:40.417753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ad95ccf3-a999-42ee-a706-9fda2a46988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:40.501011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 868/1746] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:40.502565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ad27-be50-4b00-bd43-87b4706ef1ab None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.502858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ad27-be50-4b00-bd43-87b4706ef1ab None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.503190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6ad27-be50-4b00-bd43-87b4706ef1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.519381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:40.522876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:40.558691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 879/1747] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:40.570758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:40.578264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-fef6ad27-be50-4b00-bd43-87b4706ef1ab None None] MFA Rules not processed for user `4eaa14ac2668498bbae8bd014b2d2c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:40.578462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:40.580578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-fef6ad27-be50-4b00-bd43-87b4706ef1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:40.733436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f460b1-d9a0-4fb7-a633-8ed2b0aecbcd service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:40.752844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:40.753514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.753779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.754059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:40.773390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:40.774827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:40.780990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 869/1748] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:40.783940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6ad27-be50-4b00-bd43-87b4706ef1ab None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:40.793869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 880/1749] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:40.830882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:40.917388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6ad27-be50-4b00-bd43-87b4706ef1ab None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:40.927489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:40.928163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:40.928452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:40.929067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:41.039329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:41.040781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:41.070501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de706fc2-66a3-4d8f-ba26-2f7e2cabe759 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:41.080807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192643d-ceee-4e02-8b10-a42260f1b08f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:41.081444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192643d-ceee-4e02-8b10-a42260f1b08f service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:41.081725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192643d-ceee-4e02-8b10-a42260f1b08f service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:41.082015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192643d-ceee-4e02-8b10-a42260f1b08f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:41.083833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:41.085340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:41.102129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:41.113197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 870/1750] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:41.134454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192643d-ceee-4e02-8b10-a42260f1b08f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:41.136045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192643d-ceee-4e02-8b10-a42260f1b08f service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:41.155764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 881/1751] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:41.244035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:41.245509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:41.293861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7580-0e9d-494b-b85d-90a73747ca10 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:41.294221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7580-0e9d-494b-b85d-90a73747ca10 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:41.294507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7580-0e9d-494b-b85d-90a73747ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:41.363197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ecbb7580-0e9d-494b-b85d-90a73747ca10 None None] MFA Rules not processed for user `79729883ac964badae04665e547634da`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:41.369757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ecbb7580-0e9d-494b-b85d-90a73747ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:41.488048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db301d-be39-444b-9d98-06baefdb4a9c service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:41.501395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:41.502643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:41.503325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:41.505260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] PATH_INFO: `/v3/users/af158fe3c5fe42df9ca2ec2cee039d26` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:41.508901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af158fe3c5fe42df9ca2ec2cee039d26)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:41.511681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:41.520135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 882/1752] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:41.521699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06607-8a0b-4b83-ad05-bc22682919d5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:41.524270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06607-8a0b-4b83-ad05-bc22682919d5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:41.524715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06607-8a0b-4b83-ad05-bc22682919d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:41.657443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af158fe3c5fe42df9ca2ec2cee039d26'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:41.657443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af158fe3c5fe42df9ca2ec2cee039d26'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:41.658526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af158fe3c5fe42df9ca2ec2cee039d26'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:41.689487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f8a06607-8a0b-4b83-ad05-bc22682919d5 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:41.691323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f8a06607-8a0b-4b83-ad05-bc22682919d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:41.718439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af158fe3c5fe42df9ca2ec2cee039d26'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:41.750239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af158fe3c5fe42df9ca2ec2cee039d26'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:41.760958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:41.860346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 871/1753] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:41 2022] DELETE /identity/v3/users/af158fe3c5fe42df9ca2ec2cee039d26 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:41.860346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:41.861340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:41.976833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 883/1754] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:15:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:41.978168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:41.978458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:41.978737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.006861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e20fd2-fa62-4579-97c9-0e4f9ae59c65 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:42.017281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:42.018296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:42.021870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:42.022162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.031007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.068417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:42.068417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.221928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:42.223167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 884/1755] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:42.224158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:42.233695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:42.234117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.269786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345edcb-c465-4cd5-8ba6-daaa243fc8bd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:42.284134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 872/1756] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:42.286464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:42.287542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:42.288567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:42.288984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:42.289391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.289506 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] PATH_INFO: `/v3/users/7bd4ec50fe384170971aabbee75501aa` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.292576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd4ec50fe384170971aabbee75501aa)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:42.294969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:42.311459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:42.417768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd4ec50fe384170971aabbee75501aa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:42.438034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd4ec50fe384170971aabbee75501aa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:42.440527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd4ec50fe384170971aabbee75501aa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:42.463592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fda3aa-c88d-470d-9758-4f63d24c1325 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:42.474137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910a281-93c7-402d-b21f-c4230a99ef41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:42.477545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a281-93c7-402d-b21f-c4230a99ef41 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:42.477864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a281-93c7-402d-b21f-c4230a99ef41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:42.478205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd4ec50fe384170971aabbee75501aa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:42.480969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910a281-93c7-402d-b21f-c4230a99ef41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.490063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd4ec50fe384170971aabbee75501aa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:42.501561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 885/1757] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:42 2022] DELETE /identity/v3/users/7bd4ec50fe384170971aabbee75501aa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:42.508343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:42.511254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.522905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910a281-93c7-402d-b21f-c4230a99ef41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:42.526967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910a281-93c7-402d-b21f-c4230a99ef41 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:42.589705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 873/1758] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:42.591118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:42.591421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:42.591706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.710719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:42.716691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.861286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc29d2-1fd4-45a9-8da7-bc7337805e78 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:42.879056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056352f9-317c-4562-abf6-2859a5b8ca3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:42.879706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056352f9-317c-4562-abf6-2859a5b8ca3c service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:42.880035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056352f9-317c-4562-abf6-2859a5b8ca3c service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:42.880311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056352f9-317c-4562-abf6-2859a5b8ca3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:42.893435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-056352f9-317c-4562-abf6-2859a5b8ca3c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:42.912113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:42.994446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 874/1759] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:43.056879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:43.059439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:43.158102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056352f9-317c-4562-abf6-2859a5b8ca3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:43.160609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056352f9-317c-4562-abf6-2859a5b8ca3c service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:43.207976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 886/1760] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:15:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:15:43.220797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:43.221084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:43.221366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:43.271287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:43.323350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] MFA Rules not processed for user `9fe81a429dee4fba8708445dcefa293e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:43.325482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616384b-e778-4ca9-a3a1-bb8f491bf21c None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:43.329375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:43.336140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:43.349992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:43.350588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:43.350840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:43.426641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:43.429671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:43.473576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 875/1761] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:43.726817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 887/1762] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:46.046932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:46.051133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:46.056984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:46.058441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:46.133864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6fe00-dc68-4700-9e30-c6051176bc3e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:46.135092 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5548f-30e7-414c-ae53-bcc32121b8e1 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:46.176369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:46.178239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:46.178552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:46.179617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:46.180244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:46.181143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] PATH_INFO: `/v3/projects/57de94057c094ac788a2708c46788f48` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:46.182219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:46.182772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] PATH_INFO: `/v3/users/d4ad19e9e4d8457186f3527bbb236a3b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:46.184826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ad19e9e4d8457186f3527bbb236a3b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:46.187903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:46.188587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57de94057c094ac788a2708c46788f48)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:46.190524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:46.329407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ad19e9e4d8457186f3527bbb236a3b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.358087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ad19e9e4d8457186f3527bbb236a3b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.364460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ad19e9e4d8457186f3527bbb236a3b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.382017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57de94057c094ac788a2708c46788f48', 'request_id': 'req-3db36199-b667-4c80-b4b3-526c2379113e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.400623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ad19e9e4d8457186f3527bbb236a3b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.431218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57de94057c094ac788a2708c46788f48', 'request_id': 'req-3db36199-b667-4c80-b4b3-526c2379113e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.432439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-565405fe-b438-432f-b263-72b41e9dc428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ad19e9e4d8457186f3527bbb236a3b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.446094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 888/1763] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:46 2022] DELETE /identity/v3/users/d4ad19e9e4d8457186f3527bbb236a3b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:46.455133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b060cd-2439-498f-b389-e3613fc3ecfe None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:46.455685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b060cd-2439-498f-b389-e3613fc3ecfe None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:46.456093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b060cd-2439-498f-b389-e3613fc3ecfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:46.476318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57de94057c094ac788a2708c46788f48', 'request_id': 'req-3db36199-b667-4c80-b4b3-526c2379113e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.529229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-66b060cd-2439-498f-b389-e3613fc3ecfe None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:46.532777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] The token cache is being invalidate because project 57de94057c094ac788a2708c46788f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:46.532980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-66b060cd-2439-498f-b389-e3613fc3ecfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:46.533180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.536420 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:46.563369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 876/1764] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:46 2022] DELETE /identity/v3/projects/57de94057c094ac788a2708c46788f48 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:46.576874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:46.590401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:46.813711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 889/1765] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:46.822917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:46.823324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:46.823502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:46.868884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db36199-b667-4c80-b4b3-526c2379113e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:46.903757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:46.906357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:46.907903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:46.910034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] PATH_INFO: `/v3/users/0d9cf91f80a345df839437882e36147f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:46.919089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9cf91f80a345df839437882e36147f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:46.920991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:46.927216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] MFA Rules not processed for user `13729a757e1a4f95a957fedb84705960`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:46.928673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:46.971368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:46.976005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:47.073667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9cf91f80a345df839437882e36147f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.076314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9cf91f80a345df839437882e36147f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.080005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9cf91f80a345df839437882e36147f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.129180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9cf91f80a345df839437882e36147f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.157777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9cf91f80a345df839437882e36147f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.168310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 890/1766] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 17 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:47.170683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:47.180355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:47.230226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 877/1767] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:46 2022] DELETE /identity/v3/users/0d9cf91f80a345df839437882e36147f => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:47.232130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:47.241957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:47.274673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa25eb0-ac3e-4431-b15a-d0c3d55db6c9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:47.517261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0e640-25dd-40d7-b053-8823c17beb39 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:47.531725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:47.533086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:47.533581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:47.534109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:47.542573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:47.586556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:47.588821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:47.590658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:47.591181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] PATH_INFO: `/v3/projects/431fdd69ff9a4348b07da7eee17ab886` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:47.597687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=431fdd69ff9a4348b07da7eee17ab886)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:47.602335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:47.838703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:47.842029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431fdd69ff9a4348b07da7eee17ab886', 'request_id': 'req-c0443566-8e47-4171-9690-1a84f60ade8e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.843204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:47.869053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431fdd69ff9a4348b07da7eee17ab886', 'request_id': 'req-c0443566-8e47-4171-9690-1a84f60ade8e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.876149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 878/1768] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:47.877962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:47.903545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431fdd69ff9a4348b07da7eee17ab886', 'request_id': 'req-c0443566-8e47-4171-9690-1a84f60ade8e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.904392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f8fe1-9a46-4240-bbb3-513f7a205bca service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:47.937149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] The token cache is being invalidate because project 431fdd69ff9a4348b07da7eee17ab886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:47.937451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.939377 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:47.948399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 891/1769] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:47 2022] DELETE /identity/v3/projects/431fdd69ff9a4348b07da7eee17ab886 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:47.950667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:47.956143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:48.033963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:48.052180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:48.053357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:48.053909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:48.054417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:48.057776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:48.077613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:48.083454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:48.102325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 879/1770] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:48.167987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0443566-8e47-4171-9690-1a84f60ade8e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:48.173595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:48.174616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:48.174616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:48.174884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] PATH_INFO: `/v3/users/df2cc47ef0d344479afe1d27a7be61be` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:48.177473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2cc47ef0d344479afe1d27a7be61be)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:48.180502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:48.188511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:48.304966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2cc47ef0d344479afe1d27a7be61be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:48.345976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2cc47ef0d344479afe1d27a7be61be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:48.347109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2cc47ef0d344479afe1d27a7be61be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:48.381789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2cc47ef0d344479afe1d27a7be61be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:48.402588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2cc47ef0d344479afe1d27a7be61be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:48.414495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 892/1771] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:47 2022] DELETE /identity/v3/users/df2cc47ef0d344479afe1d27a7be61be => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:49.274167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:49.276229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.301308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b86d-9299-4ce3-ba2f-3bf56a4b53f5 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:49.326263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:49.327755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.441105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:49.442344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:49.442787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:49.443213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] PATH_INFO: `/v3/projects/5ff9acd3c0ea42f8b673964ce6b1c618` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:49.445744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff9acd3c0ea42f8b673964ce6b1c618)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:49.448260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:49.468816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535efef6-714a-4d5c-b053-94e52d49b558 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:49.478181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:49.479044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:49.479443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:49.480488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] PATH_INFO: `/v3/projects/cbac62f975384765ad4ad83bf2b38206` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:49.481606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbac62f975384765ad4ad83bf2b38206)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:49.483958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:49.530462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff9acd3c0ea42f8b673964ce6b1c618', 'request_id': 'req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.540425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff9acd3c0ea42f8b673964ce6b1c618', 'request_id': 'req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.566770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff9acd3c0ea42f8b673964ce6b1c618', 'request_id': 'req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.617299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbac62f975384765ad4ad83bf2b38206', 'request_id': 'req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.629565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] The token cache is being invalidate because project 5ff9acd3c0ea42f8b673964ce6b1c618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:49.629932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbac62f975384765ad4ad83bf2b38206', 'request_id': 'req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.630052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.631848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.638415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 880/1772] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:49 2022] DELETE /identity/v3/projects/5ff9acd3c0ea42f8b673964ce6b1c618 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:49.644930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:49.647620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.653555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbac62f975384765ad4ad83bf2b38206', 'request_id': 'req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.684350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] The token cache is being invalidate because project cbac62f975384765ad4ad83bf2b38206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:49.692478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.692952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9daf50d-d932-477a-8ccd-8cdb6d03ae32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:49.707723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 893/1773] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:49 2022] DELETE /identity/v3/projects/cbac62f975384765ad4ad83bf2b38206 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:49.714051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:49.714422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:49.714929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:49.747222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:49.749052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.758727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:49.771723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1cdce-d03e-47f7-a35e-896d21b2c1fe admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:49.797165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:49.872161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:49.873054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:49.873473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:49.873753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] PATH_INFO: `/v3/users/6a58e2fccb614dc495ed11e915ee0c60` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:49.875980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a58e2fccb614dc495ed11e915ee0c60)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:49.879235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:49.885208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 894/1774] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:49.886179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:49.889943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.907733 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecc57c-f9a2-4499-a802-be368c3f738c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:49.913662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:49.914326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:49.915273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:49.915580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] PATH_INFO: `/v3/projects/f5b8d416045f46d79e5063975e81b1af` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:49.916970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b8d416045f46d79e5063975e81b1af)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:49.919838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.001148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a58e2fccb614dc495ed11e915ee0c60'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.002555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a58e2fccb614dc495ed11e915ee0c60'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.003192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a58e2fccb614dc495ed11e915ee0c60'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.023973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a58e2fccb614dc495ed11e915ee0c60'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.035282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f2da9965-6b64-4766-82f1-e206e2e42f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a58e2fccb614dc495ed11e915ee0c60'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.058151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b8d416045f46d79e5063975e81b1af', 'request_id': 'req-0111a90e-da68-4f5f-ab6e-a15d681ff722'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.061513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 881/1775] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:49 2022] DELETE /identity/v3/users/6a58e2fccb614dc495ed11e915ee0c60 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:50.064575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9ccf-b017-4aa3-b472-14d6a4672b91 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.065759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9ccf-b017-4aa3-b472-14d6a4672b91 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.065935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9ccf-b017-4aa3-b472-14d6a4672b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.070556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b8d416045f46d79e5063975e81b1af', 'request_id': 'req-0111a90e-da68-4f5f-ab6e-a15d681ff722'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.085340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b8d416045f46d79e5063975e81b1af', 'request_id': 'req-0111a90e-da68-4f5f-ab6e-a15d681ff722'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.101475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9ead9ccf-b017-4aa3-b472-14d6a4672b91 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:50.103763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9ead9ccf-b017-4aa3-b472-14d6a4672b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:50.109014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] The token cache is being invalidate because project f5b8d416045f46d79e5063975e81b1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:50.109317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.111234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.115953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 895/1776] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:49 2022] DELETE /identity/v3/projects/f5b8d416045f46d79e5063975e81b1af => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:50.123110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.124660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:50.242237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 882/1777] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:50.246930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead9ccf-b017-4aa3-b472-14d6a4672b91 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.260202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead9ccf-b017-4aa3-b472-14d6a4672b91 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.266992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.267738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.268157 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.269446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.270414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:50.270817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.272823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.275290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a90e-da68-4f5f-ab6e-a15d681ff722 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.284028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.284876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.285319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.285747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] PATH_INFO: `/v3/users/1a5a0e827a09492c9a3f10baebc9edd2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.286930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 883/1778] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:50.288228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5a0e827a09492c9a3f10baebc9edd2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.290539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.291147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.306370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cabc6-6482-4c37-9ffb-f2a74895694f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.311971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebe1eb-7eee-4afb-902a-d1e3f5c4636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.313524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebe1eb-7eee-4afb-902a-d1e3f5c4636a admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.314021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebe1eb-7eee-4afb-902a-d1e3f5c4636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.314657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebe1eb-7eee-4afb-902a-d1e3f5c4636a admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.315360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebe1eb-7eee-4afb-902a-d1e3f5c4636a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.317381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ebe1eb-7eee-4afb-902a-d1e3f5c4636a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.346254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:50.358392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5a0e827a09492c9a3f10baebc9edd2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.362555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 884/1779] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:50 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:15:50.367080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548282d-e7e0-4eed-b7c4-6f4a31943fa3 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.367760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548282d-e7e0-4eed-b7c4-6f4a31943fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.367760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548282d-e7e0-4eed-b7c4-6f4a31943fa3 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.369221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 885/1780] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:50.369933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548282d-e7e0-4eed-b7c4-6f4a31943fa3 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.374690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5a0e827a09492c9a3f10baebc9edd2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.375956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5a0e827a09492c9a3f10baebc9edd2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.385609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:50.393426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5a0e827a09492c9a3f10baebc9edd2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.408292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1c10aa97-8f05-41e0-9452-ee83f0e2da5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5a0e827a09492c9a3f10baebc9edd2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:50.419205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 896/1781] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:50 2022] DELETE /identity/v3/users/1a5a0e827a09492c9a3f10baebc9edd2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:50.421334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.424240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.424385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.453842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548282d-e7e0-4eed-b7c4-6f4a31943fa3 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.454471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:50.456008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:50.550163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.552090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.552694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.553432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.554493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.558206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.564832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 897/1782] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:50.608690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 886/1783] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:50 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:50.613576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.616093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:50.628030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.629811 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:50.644835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3148b-0923-425c-9224-e095a152a8c8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.653252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.654271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.654876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.655982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.657735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.660952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.671002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab52680-9c52-421b-b925-3bb2b0af7bec admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.686346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 898/1784] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:50.688557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.693645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.694364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.694784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.696731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.712258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f47295-3124-46ac-a21b-52cee37f449f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.729810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.730310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94571-f901-44da-b29c-7f8ef24d3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.733282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94571-f901-44da-b29c-7f8ef24d3353 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.734963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94571-f901-44da-b29c-7f8ef24d3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.735270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94571-f901-44da-b29c-7f8ef24d3353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.736374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.737784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94571-f901-44da-b29c-7f8ef24d3353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.743109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94571-f901-44da-b29c-7f8ef24d3353 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.772579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 887/1785] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:50.782588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.783755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 899/1786] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:50.801203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895bda1-dcc5-4177-8f9c-4b7c443466f7 service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.808359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.809316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.809745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.810012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] PATH_INFO: `/v3/projects/d142c9daf27944ada6f0c34d248afdda/users/7fd9d838d4254078966aee189be6532a/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.862155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d142c9daf27944ada6f0c34d248afdda, user_id=7fd9d838d4254078966aee189be6532a, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.869026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.923945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 888/1787] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:50 2022] PUT /identity/v3/projects/d142c9daf27944ada6f0c34d248afdda/users/7fd9d838d4254078966aee189be6532a/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:50.934445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d0b0-61e2-4b9e-8232-8bce091d80fa None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.934834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d0b0-61e2-4b9e-8232-8bce091d80fa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.935237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0d0b0-61e2-4b9e-8232-8bce091d80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.999938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:51.011986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7ff0d0b0-61e2-4b9e-8232-8bce091d80fa None None] MFA Rules not processed for user `7fd9d838d4254078966aee189be6532a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:51.013381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7ff0d0b0-61e2-4b9e-8232-8bce091d80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:51.016967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:51.154128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f961aa1-d6a7-466f-abf0-f4bd9802394f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:51.170719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:51.171573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.171888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.173679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] PATH_INFO: `/v3/projects/27c9db653f8a41a999a078a96a3ee5a9` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.176703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c9db653f8a41a999a078a96a3ee5a9)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:51.179109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:51.182423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 900/1788] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:51.187192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0d0b0-61e2-4b9e-8232-8bce091d80fa None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:51.215698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0d0b0-61e2-4b9e-8232-8bce091d80fa None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:51.217061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:51.232455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:51.233096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.238579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.239256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.241628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:51.272219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:51.340926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:51.395785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 901/1789] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:51 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:51.398700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:51.400330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c9db653f8a41a999a078a96a3ee5a9', 'request_id': 'req-33288ed0-4358-4c85-8d37-62b3405cd1f1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:51.413885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c9db653f8a41a999a078a96a3ee5a9', 'request_id': 'req-33288ed0-4358-4c85-8d37-62b3405cd1f1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:51.432333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c9db653f8a41a999a078a96a3ee5a9', 'request_id': 'req-33288ed0-4358-4c85-8d37-62b3405cd1f1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:51.511524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] The token cache is being invalidate because project 27c9db653f8a41a999a078a96a3ee5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:51.516363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:51.517507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-33288ed0-4358-4c85-8d37-62b3405cd1f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:51.519722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 889/1790] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:50 2022] DELETE /identity/v3/projects/27c9db653f8a41a999a078a96a3ee5a9 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:51.524216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d499be-2450-4418-9c9b-7a0287b50406 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.524759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d499be-2450-4418-9c9b-7a0287b50406 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.525255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d499be-2450-4418-9c9b-7a0287b50406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.574525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a3d499be-2450-4418-9c9b-7a0287b50406 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:51.577710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a3d499be-2450-4418-9c9b-7a0287b50406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:51.708210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8d319-a7c0-4ba8-ae6a-d97c1b6e87ce admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:51.731958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:51.736985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.737553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.739371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.740380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:51.743487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:51.847247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 902/1791] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:51 2022] POST /identity/v3/users => generated 288 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:15:51.854082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:51.860963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:51.891381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 890/1792] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:51.892909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465b5a-6594-4a3b-9850-ebdb3b423054 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.893200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465b5a-6594-4a3b-9850-ebdb3b423054 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.895364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465b5a-6594-4a3b-9850-ebdb3b423054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.913451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024aa26-aa4f-4c80-b349-2385f08b30f4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:51.949784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:51.954992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-73465b5a-6594-4a3b-9850-ebdb3b423054 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:51.955171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.956595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-73465b5a-6594-4a3b-9850-ebdb3b423054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:51.962084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.963185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.965043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:51.969772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:51.972994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 891/1793] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:51.978134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465b5a-6594-4a3b-9850-ebdb3b423054 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:51.989386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465b5a-6594-4a3b-9850-ebdb3b423054 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:51.995235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:51.996113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:51.996553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:51.996990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:51.999189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:51.999679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.002386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:52.037585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 903/1794] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:52.041488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:52.053107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 892/1795] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:52.056127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:52.093041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a987a3-ca52-4eac-a4cb-24cc7c74aead admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:52.120373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:52.121903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.126215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.127366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] PATH_INFO: `/v3/projects/8105f41d167f48e3b945f63b2d3ec875/users/2bba1ecfdd42440d81d872f7fd34b952/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.129622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce452460-a4ad-469d-8dc6-0ee3e8ad6ff9 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:52.149915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:52.150561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.150841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.151144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.152125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.166643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:52.207408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8105f41d167f48e3b945f63b2d3ec875, user_id=2bba1ecfdd42440d81d872f7fd34b952, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.220753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:52.251098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 893/1796] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:52 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:52.256607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:52.269011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 904/1797] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:52 2022] PUT /identity/v3/projects/8105f41d167f48e3b945f63b2d3ec875/users/2bba1ecfdd42440d81d872f7fd34b952/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:52.270635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:52.360460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f01f8-09bd-41ac-b730-9b5818d6193d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:52.368107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:52.369175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.370290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.370852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.371708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.375464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:52.403874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 905/1798] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:52.404797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:52.433306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc82a0d-f7fb-44fb-84a7-8747af301519 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:52.441778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd52b9-3c11-4569-9a9c-5c58e6e67cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:52.442603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd52b9-3c11-4569-9a9c-5c58e6e67cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.442716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd52b9-3c11-4569-9a9c-5c58e6e67cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.443004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd52b9-3c11-4569-9a9c-5c58e6e67cd1 admin admin] PATH_INFO: `/v3/projects/8105f41d167f48e3b945f63b2d3ec875/users/2bba1ecfdd42440d81d872f7fd34b952/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.464156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd52b9-3c11-4569-9a9c-5c58e6e67cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8105f41d167f48e3b945f63b2d3ec875, user_id=2bba1ecfdd42440d81d872f7fd34b952, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.466974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd52b9-3c11-4569-9a9c-5c58e6e67cd1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:52.497997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:52.505842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d93468-14c4-4e1d-be84-a85e920777ed admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:52.546398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 906/1799] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:52 2022] PUT /identity/v3/projects/8105f41d167f48e3b945f63b2d3ec875/users/2bba1ecfdd42440d81d872f7fd34b952/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:52.551114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ed364-51b3-4c2e-88e0-de0d61a4ff53 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.554776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ed364-51b3-4c2e-88e0-de0d61a4ff53 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.555105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ed364-51b3-4c2e-88e0-de0d61a4ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.644284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7e9ed364-51b3-4c2e-88e0-de0d61a4ff53 None None] MFA Rules not processed for user `2bba1ecfdd42440d81d872f7fd34b952`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:52.645529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7e9ed364-51b3-4c2e-88e0-de0d61a4ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:52.706633 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:52.707275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.707563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.708502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:52.708901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.709611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.716634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:52.818495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 894/1800] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:52 2022] POST /identity/v3/users => generated 287 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:52.819648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:52.828794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:52.919035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be14e34-2c29-4729-969d-3de4be7cc54b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:52.962044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:52.967301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:52.968557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:52.969888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] PATH_INFO: `/v3/projects/4cb0466622184f21bf9f487296968b04` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:52.974621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb0466622184f21bf9f487296968b04)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:52.988586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 907/1801] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:52.995550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ed364-51b3-4c2e-88e0-de0d61a4ff53 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:52.998265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:53.023725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ed364-51b3-4c2e-88e0-de0d61a4ff53 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:53.039583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:53.040239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:53.040523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:53.041339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:53.044057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:53.050211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:53.085417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 908/1802] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:53.093104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:53.101116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:53.173236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb0466622184f21bf9f487296968b04', 'request_id': 'req-c603a131-7b3f-4305-a558-4fb5f52e15df'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:53.190899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb0466622184f21bf9f487296968b04', 'request_id': 'req-c603a131-7b3f-4305-a558-4fb5f52e15df'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:53.217601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb0466622184f21bf9f487296968b04', 'request_id': 'req-c603a131-7b3f-4305-a558-4fb5f52e15df'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:53.264258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] The token cache is being invalidate because project 4cb0466622184f21bf9f487296968b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:53.264258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:53.264658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:53.273672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 895/1803] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:52 2022] DELETE /identity/v3/projects/4cb0466622184f21bf9f487296968b04 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:53.279118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:53.279765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:53.314705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af87a2-9179-4519-8927-21438b279ce0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:53.459197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f0d50-6ac2-4df1-8303-1e7897b9a8bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:53.459956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f0d50-6ac2-4df1-8303-1e7897b9a8bb service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:53.460275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f0d50-6ac2-4df1-8303-1e7897b9a8bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:53.460452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f0d50-6ac2-4df1-8303-1e7897b9a8bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:53.465059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-290f0d50-6ac2-4df1-8303-1e7897b9a8bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:53.523772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603a131-7b3f-4305-a558-4fb5f52e15df admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:53.556684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad393e8-0732-4f5b-bd8a-871b403ee4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:53.557377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad393e8-0732-4f5b-bd8a-871b403ee4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:53.557769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad393e8-0732-4f5b-bd8a-871b403ee4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:53.558055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad393e8-0732-4f5b-bd8a-871b403ee4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:53.558733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad393e8-0732-4f5b-bd8a-871b403ee4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:53.560455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad393e8-0732-4f5b-bd8a-871b403ee4e6 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:53.584670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 896/1804] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:53.598324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8064119-8db5-43aa-8efd-aaf737492864 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:53.598610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8064119-8db5-43aa-8efd-aaf737492864 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:53.598899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8064119-8db5-43aa-8efd-aaf737492864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:53.649126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a8064119-8db5-43aa-8efd-aaf737492864 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:53.650362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a8064119-8db5-43aa-8efd-aaf737492864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:53.661007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 897/1805] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:53.669848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8064119-8db5-43aa-8efd-aaf737492864 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:53.713158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8064119-8db5-43aa-8efd-aaf737492864 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:53.733718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f0d50-6ac2-4df1-8303-1e7897b9a8bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:53.735505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72946366-a6b2-48bc-a0fc-99dc6ff701a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:53.735859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f0d50-6ac2-4df1-8303-1e7897b9a8bb service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:53.737897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946366-a6b2-48bc-a0fc-99dc6ff701a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:53.738396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946366-a6b2-48bc-a0fc-99dc6ff701a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:53.739550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946366-a6b2-48bc-a0fc-99dc6ff701a0 admin admin] PATH_INFO: `/v3/projects/8194d79e782b49fda02c031ea5a8f308/users/fc8d421028674ab59ee16d3c98bc3bb7/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:53.749524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:53.814504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 909/1806] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:53.820802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd60f-f731-4a76-b7d7-1b541197ea48 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:53.825949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd60f-f731-4a76-b7d7-1b541197ea48 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:53.826128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72946366-a6b2-48bc-a0fc-99dc6ff701a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8194d79e782b49fda02c031ea5a8f308, user_id=fc8d421028674ab59ee16d3c98bc3bb7, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:53.826238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdd60f-f731-4a76-b7d7-1b541197ea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:53.829760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72946366-a6b2-48bc-a0fc-99dc6ff701a0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:53.876467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 898/1807] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:53 2022] PUT /identity/v3/projects/8194d79e782b49fda02c031ea5a8f308/users/fc8d421028674ab59ee16d3c98bc3bb7/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:53.893487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab9f3-5999-4632-bccd-b9b198db20dd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:53.893783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab9f3-5999-4632-bccd-b9b198db20dd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:53.894069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cab9f3-5999-4632-bccd-b9b198db20dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:53.928187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-49fdd60f-f731-4a76-b7d7-1b541197ea48 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:53.929451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-49fdd60f-f731-4a76-b7d7-1b541197ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:53.954960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:54.005011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-27cab9f3-5999-4632-bccd-b9b198db20dd None None] MFA Rules not processed for user `fc8d421028674ab59ee16d3c98bc3bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:54.007535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-27cab9f3-5999-4632-bccd-b9b198db20dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:54.124752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 910/1808] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:54.126456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd60f-f731-4a76-b7d7-1b541197ea48 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.156878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdd60f-f731-4a76-b7d7-1b541197ea48 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.169498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 899/1809] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:54.174095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cab9f3-5999-4632-bccd-b9b198db20dd None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.174279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.174844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.175143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.175412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.177561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:15:54.177901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.181867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.205839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cab9f3-5999-4632-bccd-b9b198db20dd None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.211949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 911/1810] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:15:54.216029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.226590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.227297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.227586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.227935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.228716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.230924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.237851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22914c0c-485e-41d6-a113-0ec9922c13c6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.252340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.252982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.253271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.253554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.254202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.258853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.337799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 900/1811] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:54 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:54.341402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.356517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 912/1812] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:54 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:54.357442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.542190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40619c99-112e-44fc-a389-5d1e8be74241 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.556777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.557429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.557717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.557994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.558637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.560049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62814e3-c549-46fd-a2c2-7f504c77d731 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.569476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.578716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.579396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.579837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.580287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.585459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.590197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.655375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 913/1813] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:54 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:54.658952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.683742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 901/1814] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:54 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:54.683961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc02ca-decb-4183-9c16-b7b7fd8b878f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.685022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.697191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.699130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.699730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.700108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.701488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.707710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.724005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bbcb-4c1f-44ac-832a-60f6ecde3c80 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.740701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.742868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.743165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.744676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.747702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.753011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.779524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 914/1815] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:54.785033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.812094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 902/1816] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:54.815939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:54.849476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645b2e-8268-4af8-9035-0987b2ae7be8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.874790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a48624-bac4-4cf3-872e-e833d05b4a65 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:54.882177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.882641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.882943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.883226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.883894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:54.886073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:54.924805 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:54.925159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:54.925497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:54.925757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] PATH_INFO: `/v3/projects/4f191bcc3e654c4e807252b566f3ecf6/users/6ba19c3dfef443079a7fca70419f17f2/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:54.982160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 915/1817] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:54.991825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:55.044054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f191bcc3e654c4e807252b566f3ecf6, user_id=6ba19c3dfef443079a7fca70419f17f2, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:55.051960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457af9e9-8250-431e-bb1c-d5a633b8c8dd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:55.053419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:55.067607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:55.071670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:55.073767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:55.076054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] PATH_INFO: `/v3/projects/682c702822154b27ab4d468a787ffd3d/users/d219b6d3e94d45978074f33d45132b67/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:55.121776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 903/1818] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:54 2022] PUT /identity/v3/projects/4f191bcc3e654c4e807252b566f3ecf6/users/6ba19c3dfef443079a7fca70419f17f2/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:55.127604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:55.142923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682c702822154b27ab4d468a787ffd3d, user_id=d219b6d3e94d45978074f33d45132b67, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:55.145742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:55.152404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:55.206944 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 916/1819] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:54 2022] PUT /identity/v3/projects/682c702822154b27ab4d468a787ffd3d/users/d219b6d3e94d45978074f33d45132b67/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:55.208842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:55.214878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:55.291419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:55.384429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620418fb-f371-4a92-ba07-f809f52083ec admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:55.452041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624440a4-103a-480c-ae85-0f17177295c1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:55.463208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:55.468475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:55.468594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:55.469456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] PATH_INFO: `/v3/users/7fd9d838d4254078966aee189be6532a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:55.471018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd9d838d4254078966aee189be6532a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:55.473449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:55.495156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c321557-a533-4d5d-9c10-3ddcebd3adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:55.495790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321557-a533-4d5d-9c10-3ddcebd3adbe admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:55.496175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321557-a533-4d5d-9c10-3ddcebd3adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:55.496455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321557-a533-4d5d-9c10-3ddcebd3adbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:55.497397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c321557-a533-4d5d-9c10-3ddcebd3adbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:55.500231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c321557-a533-4d5d-9c10-3ddcebd3adbe admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:55.516791 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 904/1820] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:55.518805 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637489-bc04-45c1-a067-c2923301e52a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:55.519262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637489-bc04-45c1-a067-c2923301e52a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:55.519549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69637489-bc04-45c1-a067-c2923301e52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:55.585207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-69637489-bc04-45c1-a067-c2923301e52a None None] MFA Rules not processed for user `d219b6d3e94d45978074f33d45132b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:55.588544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-69637489-bc04-45c1-a067-c2923301e52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:55.614718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd9d838d4254078966aee189be6532a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:55.635097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd9d838d4254078966aee189be6532a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:55.636415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd9d838d4254078966aee189be6532a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:55.690440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd9d838d4254078966aee189be6532a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:55.702743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd9d838d4254078966aee189be6532a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:55.713925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 917/1821] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:55 2022] DELETE /identity/v3/users/7fd9d838d4254078966aee189be6532a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:55.714754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:55.716998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:55.776866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 905/1822] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:55.776866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:55.776866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:55.777233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:55.844349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:55.848567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:55.891544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5071b2-6cdf-4ef2-acb0-f30b4302d156 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:55.920946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:55.922447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:55.922889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:55.925920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] PATH_INFO: `/v3/projects/4f191bcc3e654c4e807252b566f3ecf6/users/6ba19c3dfef443079a7fca70419f17f2/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:55.936210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f191bcc3e654c4e807252b566f3ecf6, user_id=6ba19c3dfef443079a7fca70419f17f2, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:55.947527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:55.949765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:55.980579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 918/1823] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:55 2022] PUT /identity/v3/projects/4f191bcc3e654c4e807252b566f3ecf6/users/6ba19c3dfef443079a7fca70419f17f2/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:55.981778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:55.991549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.034420 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 906/1824] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:56.036746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:56.037801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.067255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec99aa9-84bd-401b-b6f4-aa6a3637ebcc None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:56.127160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:56.196985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:56.197761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.198362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.199668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] PATH_INFO: `/v3/users/79dc209026ce473cad160486c12c5801` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.201075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dc209026ce473cad160486c12c5801)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:56.203980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:56.212823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d896-6f66-410b-9ca9-37b1b39e7ded admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:56.236355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09857441-9da0-4bb6-9a24-4f4f0d31697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:56.240274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857441-9da0-4bb6-9a24-4f4f0d31697c admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.240576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857441-9da0-4bb6-9a24-4f4f0d31697c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.243961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857441-9da0-4bb6-9a24-4f4f0d31697c admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.245650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09857441-9da0-4bb6-9a24-4f4f0d31697c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:56.247693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09857441-9da0-4bb6-9a24-4f4f0d31697c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:56.340342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 919/1825] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:15:55 2022] POST /identity/v3/projects => generated 381 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:56.342817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.343114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.343392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.368099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dc209026ce473cad160486c12c5801'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:56.369282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dc209026ce473cad160486c12c5801'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:56.370089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dc209026ce473cad160486c12c5801'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:56.396063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dc209026ce473cad160486c12c5801'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:56.405135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-976720a7-a2c0-4b84-aa32-3019156ef119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dc209026ce473cad160486c12c5801'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:56.409645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] MFA Rules not processed for user `6ba19c3dfef443079a7fca70419f17f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:56.410959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.429019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 907/1826] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:56 2022] DELETE /identity/v3/users/79dc209026ce473cad160486c12c5801 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:56.429019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce04cca-4ff4-45d2-a087-86e1b25f7239 None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.429019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce04cca-4ff4-45d2-a087-86e1b25f7239 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.429019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce04cca-4ff4-45d2-a087-86e1b25f7239 None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.430156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 908/1827] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:56.430914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce04cca-4ff4-45d2-a087-86e1b25f7239 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:56.433837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9ce04cca-4ff4-45d2-a087-86e1b25f7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.583855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 920/1828] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:56.583855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:56.583855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.584742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce04cca-4ff4-45d2-a087-86e1b25f7239 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:56.607655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8192b9-cf9d-4718-b136-6177417d2bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:56.610110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8192b9-cf9d-4718-b136-6177417d2bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.610779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8192b9-cf9d-4718-b136-6177417d2bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.611211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8192b9-cf9d-4718-b136-6177417d2bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.617701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-af8192b9-cf9d-4718-b136-6177417d2bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.677051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:56.681549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90722e73-84df-4b19-828a-8aa06c36424b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:56.789646 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:56.806333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:56.806970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.807251 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.807627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.808202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:56.810152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:56.843517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8192b9-cf9d-4718-b136-6177417d2bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:56.848297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8192b9-cf9d-4718-b136-6177417d2bc2 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:56.863755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 921/1829] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:15:56 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:15:56.866162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 909/1830] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:56.867679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:56.867880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbcfea-7f89-48c0-9105-ffca7c9d47d4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.868146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbcfea-7f89-48c0-9105-ffca7c9d47d4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.868421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbcfea-7f89-48c0-9105-ffca7c9d47d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.870502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.894167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-07dbcfea-7f89-48c0-9105-ffca7c9d47d4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:56.896263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-07dbcfea-7f89-48c0-9105-ffca7c9d47d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:56.906705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 910/1831] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:56.908491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50ad69-e9c0-4b29-97c5-b63769bc268a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:56.908778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50ad69-e9c0-4b29-97c5-b63769bc268a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:56.909054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50ad69-e9c0-4b29-97c5-b63769bc268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:56.941362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4f50ad69-e9c0-4b29-97c5-b63769bc268a None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:56.942740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4f50ad69-e9c0-4b29-97c5-b63769bc268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:57.015112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a6af4-7de7-4d3a-a195-c1c66c4aaae1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:57.020367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:57.021132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.021502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.022041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.025065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:57.029098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 911/1832] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:15:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:57.029962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50ad69-e9c0-4b29-97c5-b63769bc268a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:57.044777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50ad69-e9c0-4b29-97c5-b63769bc268a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:57.051412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:57.052174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.052453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.052727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.053380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:57.055184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:57.073250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 912/1833] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:57.074194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:57.076386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:57.093111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464256a5-6803-4c60-9a60-a8c5ae615370 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:57.100044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:57.101750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.102046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.102738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.119435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:57.121209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:57.121345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:57.132464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:57.134148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 913/1834] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:57.134970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:57.147542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429251-811f-4389-9075-60e54ba94829 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:57.152946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:57.153765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.154057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.154337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] PATH_INFO: `/v3/projects/629c145163e84203ad54643c93902f8e/users/96d355dbfd0d4b588f8e40d64ec4cfba/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.155531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 922/1835] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:57.157462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:57.161354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:57.176241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629c145163e84203ad54643c93902f8e, user_id=96d355dbfd0d4b588f8e40d64ec4cfba, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:57.179045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:57.184099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e353b-d607-4815-802b-51b682338eb9 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:57.199238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 914/1836] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:57 2022] PUT /identity/v3/projects/629c145163e84203ad54643c93902f8e/users/96d355dbfd0d4b588f8e40d64ec4cfba/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:57.205005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:57.208153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:57.212331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.213541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.214009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.261629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:57.263255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:57.299293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 923/1837] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:57.314161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:57.349765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdfb9e-ca3e-4c7b-b9f8-c486f7b42283 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:57.361538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82de7-1c63-460a-9008-870c67f3ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:57.362181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82de7-1c63-460a-9008-870c67f3ab65 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.362466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82de7-1c63-460a-9008-870c67f3ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.362746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82de7-1c63-460a-9008-870c67f3ab65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.363407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82de7-1c63-460a-9008-870c67f3ab65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:57.365690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82de7-1c63-460a-9008-870c67f3ab65 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:57.404743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 915/1838] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:15:57.410150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:57.431546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45b2c9-2aad-42c4-9342-0ab4a33d4c66 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:57.446837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:57.449658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.450809 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.451262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] PATH_INFO: `/v3/projects/629c145163e84203ad54643c93902f8e/users/96d355dbfd0d4b588f8e40d64ec4cfba/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.459707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629c145163e84203ad54643c93902f8e, user_id=96d355dbfd0d4b588f8e40d64ec4cfba, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:57.470102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:57.498514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 924/1839] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:15:57 2022] PUT /identity/v3/projects/629c145163e84203ad54643c93902f8e/users/96d355dbfd0d4b588f8e40d64ec4cfba/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:15:57.515287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:57.517099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:57.517537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:57.602808 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] MFA Rules not processed for user `96d355dbfd0d4b588f8e40d64ec4cfba`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:57.608770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:57.864955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 916/1840] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:15:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:57.958337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:58.121053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be1aa-561b-412f-a4ad-e8a49ca1cbd6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:58.133902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:58.134897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:58.135189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:58.135470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:58.185774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:58.189948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:58.217754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 925/1841] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:58.905485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:58.908905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:59.067590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:59.069247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:59.113532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:59.228038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af54b-90af-4975-9722-26e35ca23335 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:59.251818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:59.252479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:59.252761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:59.253036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] PATH_INFO: `/v3/projects/9c9abca118044d919be7b76d7fdd6e2c` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:59.266461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9abca118044d919be7b76d7fdd6e2c)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:59.275095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:59.438745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23289aa-a96b-4093-9910-98d67cde4e61 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:59.447980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9abca118044d919be7b76d7fdd6e2c', 'request_id': 'req-5845370f-7c35-4b1d-9b34-aeeb57953b62'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:59.476589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9abca118044d919be7b76d7fdd6e2c', 'request_id': 'req-5845370f-7c35-4b1d-9b34-aeeb57953b62'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:59.495710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9abca118044d919be7b76d7fdd6e2c', 'request_id': 'req-5845370f-7c35-4b1d-9b34-aeeb57953b62'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:59.502556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:59.550208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] The token cache is being invalidate because project 9c9abca118044d919be7b76d7fdd6e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:15:59.550795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:59.555264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:59.557343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 917/1842] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:58 2022] DELETE /identity/v3/projects/9c9abca118044d919be7b76d7fdd6e2c => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:15:59.564246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:59.570789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:59.667725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:59.668514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:59.668751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:59.669020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] PATH_INFO: `/v3/projects/d142c9daf27944ada6f0c34d248afdda` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:59.672386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d142c9daf27944ada6f0c34d248afdda)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:59.674558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:59.763878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845370f-7c35-4b1d-9b34-aeeb57953b62 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:59.772108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:59.773126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:59.773526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:59.774436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] PATH_INFO: `/v3/users/d219b6d3e94d45978074f33d45132b67` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:59.776228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d219b6d3e94d45978074f33d45132b67)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:59.783780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:59.862867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd142c9daf27944ada6f0c34d248afdda', 'request_id': 'req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:59.892866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd142c9daf27944ada6f0c34d248afdda', 'request_id': 'req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:15:59.949466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd142c9daf27944ada6f0c34d248afdda', 'request_id': 'req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.035029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] The token cache is being invalidate because project d142c9daf27944ada6f0c34d248afdda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:00.036119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.041996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.054717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 926/1843] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:15:59 2022] DELETE /identity/v3/projects/d142c9daf27944ada6f0c34d248afdda => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:00.055935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:00.064283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:00.067743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd219b6d3e94d45978074f33d45132b67'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.068924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd219b6d3e94d45978074f33d45132b67'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.071143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd219b6d3e94d45978074f33d45132b67'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.153781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd219b6d3e94d45978074f33d45132b67'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.210990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd219b6d3e94d45978074f33d45132b67'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.266062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 918/1844] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:15:59 2022] DELETE /identity/v3/users/d219b6d3e94d45978074f33d45132b67 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:00.273490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:00.286397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:00.357031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:00.412293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef5d8b-6ebe-4fa5-b884-e8a6663b7685 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:00.495018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f62f6-34e6-4b14-bb88-1babacfc7064 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:00.520432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:00.521590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:00.522112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:00.522635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] PATH_INFO: `/v3/users/2bba1ecfdd42440d81d872f7fd34b952` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:00.527340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bba1ecfdd42440d81d872f7fd34b952)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:00.530798 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:00.534405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:00.535057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:00.535359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:00.535609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] PATH_INFO: `/v3/users/9432a43503d4412484ca4e287a1a7530` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:00.536826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9432a43503d4412484ca4e287a1a7530)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:00.538728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:00.554264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:00.593097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bba1ecfdd42440d81d872f7fd34b952'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.594108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bba1ecfdd42440d81d872f7fd34b952'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.595083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bba1ecfdd42440d81d872f7fd34b952'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.597751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9432a43503d4412484ca4e287a1a7530'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.606391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9432a43503d4412484ca4e287a1a7530'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.607108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9432a43503d4412484ca4e287a1a7530'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.612677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bba1ecfdd42440d81d872f7fd34b952'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.621027 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7d5c1c6a-206d-4205-aecb-a2805d1ef201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bba1ecfdd42440d81d872f7fd34b952'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.622159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9432a43503d4412484ca4e287a1a7530'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.633386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9432a43503d4412484ca4e287a1a7530'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:00.637353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 919/1845] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:00 2022] DELETE /identity/v3/users/2bba1ecfdd42440d81d872f7fd34b952 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:00.638614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:00.638911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:00.639182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:00.650572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 927/1846] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:00 2022] DELETE /identity/v3/users/9432a43503d4412484ca4e287a1a7530 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:00.664052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:00.665215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:00.758352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 920/1847] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:00.773786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:00.776461 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:00.880166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98224-857a-4f68-9ea2-fcc7df34e0da admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:00.884948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:00.885782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:00.886120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:00.886408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:00.900039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:00.901884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:00.913862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 928/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:01.169827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.171446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.198179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421486e-1fc1-47fa-bcb4-ebd775731660 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:01.204424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:01.205192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.205541 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.205881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] PATH_INFO: `/v3/projects/8105f41d167f48e3b945f63b2d3ec875` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.207147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8105f41d167f48e3b945f63b2d3ec875)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:01.209213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:01.255063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.257449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.274236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8105f41d167f48e3b945f63b2d3ec875', 'request_id': 'req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.281759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8105f41d167f48e3b945f63b2d3ec875', 'request_id': 'req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.295509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8105f41d167f48e3b945f63b2d3ec875', 'request_id': 'req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.296333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d76859-858b-484a-b716-1712c7eab925 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:01.310894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] The token cache is being invalidate because project 8105f41d167f48e3b945f63b2d3ec875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:01.311412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.312537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aeed0acc-c5c5-4cbd-ba5f-5522f67f8ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.314539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 921/1849] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:01 2022] DELETE /identity/v3/projects/8105f41d167f48e3b945f63b2d3ec875 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:01.320104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.320398 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.320733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.321397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:01.353725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:01.355775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.369821 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:01.403115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:01.403836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.404132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.404409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] PATH_INFO: `/v3/projects/738171ea991940348836ada04ab6ca9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.408231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738171ea991940348836ada04ab6ca9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:01.412012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:01.439999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 922/1850] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:01.441069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.442764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.457430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1b2f5-8dac-45d6-813d-1de812290fa1 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:01.463213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:01.463956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.464243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.464524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] PATH_INFO: `/v3/projects/682c702822154b27ab4d468a787ffd3d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.465896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=682c702822154b27ab4d468a787ffd3d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:01.468026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:01.479767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738171ea991940348836ada04ab6ca9f', 'request_id': 'req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.486594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738171ea991940348836ada04ab6ca9f', 'request_id': 'req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.495964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738171ea991940348836ada04ab6ca9f', 'request_id': 'req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.510459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] The token cache is being invalidate because project 738171ea991940348836ada04ab6ca9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:01.510842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.511843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cfc4aded-d4be-4e84-b1f7-2a6ca7f22694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.513616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 929/1851] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:01 2022] DELETE /identity/v3/projects/738171ea991940348836ada04ab6ca9f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:01.514816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.515095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.515960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.538747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:01.540076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.541438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682c702822154b27ab4d468a787ffd3d', 'request_id': 'req-206d35ea-074f-49c1-9c9c-631f77bfb95b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.552612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682c702822154b27ab4d468a787ffd3d', 'request_id': 'req-206d35ea-074f-49c1-9c9c-631f77bfb95b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.564664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682c702822154b27ab4d468a787ffd3d', 'request_id': 'req-206d35ea-074f-49c1-9c9c-631f77bfb95b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.582321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] The token cache is being invalidate because project 682c702822154b27ab4d468a787ffd3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:01.582321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.583391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-206d35ea-074f-49c1-9c9c-631f77bfb95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.585010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 923/1852] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:01 2022] DELETE /identity/v3/projects/682c702822154b27ab4d468a787ffd3d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:01.586215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921143ed-bc9d-4009-b8c4-3796d01803c4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.586500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921143ed-bc9d-4009-b8c4-3796d01803c4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.586788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921143ed-bc9d-4009-b8c4-3796d01803c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.612122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-921143ed-bc9d-4009-b8c4-3796d01803c4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:01.614334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-921143ed-bc9d-4009-b8c4-3796d01803c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.634123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 930/1853] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:01.635655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.637510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.653314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89064cd8-9b39-4d4b-be58-a3ef50fc8bba None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:01.659823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:01.661032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.661394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.661745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] PATH_INFO: `/v3/users/96d355dbfd0d4b588f8e40d64ec4cfba` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.663578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d355dbfd0d4b588f8e40d64ec4cfba)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:01.665901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:01.712712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 924/1854] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:01.713378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921143ed-bc9d-4009-b8c4-3796d01803c4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.732216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921143ed-bc9d-4009-b8c4-3796d01803c4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:01.737659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c649c9-479e-4f61-b90e-b58a2cb0bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:01.738270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c649c9-479e-4f61-b90e-b58a2cb0bf86 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.738549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c649c9-479e-4f61-b90e-b58a2cb0bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.738815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c649c9-479e-4f61-b90e-b58a2cb0bf86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.739038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:01.739465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c649c9-479e-4f61-b90e-b58a2cb0bf86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:01.739767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c649c9-479e-4f61-b90e-b58a2cb0bf86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:01.741477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c649c9-479e-4f61-b90e-b58a2cb0bf86 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:01.748105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d355dbfd0d4b588f8e40d64ec4cfba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.759552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 925/1855] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:01.759552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857ae6-f7ac-4ffd-bf11-ea3473fe3af1 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.759552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857ae6-f7ac-4ffd-bf11-ea3473fe3af1 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.759552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857ae6-f7ac-4ffd-bf11-ea3473fe3af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.762983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d355dbfd0d4b588f8e40d64ec4cfba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.763764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d355dbfd0d4b588f8e40d64ec4cfba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.778088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d355dbfd0d4b588f8e40d64ec4cfba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.778730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-24857ae6-f7ac-4ffd-bf11-ea3473fe3af1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:01.779969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-24857ae6-f7ac-4ffd-bf11-ea3473fe3af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.786742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d355dbfd0d4b588f8e40d64ec4cfba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:01.788761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 926/1856] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:01.789614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857ae6-f7ac-4ffd-bf11-ea3473fe3af1 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.794428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 931/1857] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:01 2022] DELETE /identity/v3/users/96d355dbfd0d4b588f8e40d64ec4cfba => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:01.795445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.796920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.801938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857ae6-f7ac-4ffd-bf11-ea3473fe3af1 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:01.830216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:01.885725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:01.886526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.886923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.887305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.888117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:01.890117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:01.906360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb6eed-4cb5-443a-a88b-48f4f5d37b44 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:01.912050 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:01.912751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:01.913033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:01.913307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:01.913959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:01.914266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:01.915901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:01.923926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 927/1858] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:01 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:01.925121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.926907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:01.932889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 932/1859] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:01.933848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:01.946254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145b678-7993-4b26-a290-da7d823283f0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.006049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f8ed8-a762-4792-aa4c-b3dcc4baff55 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.011888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.012590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.012944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.013224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.013996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.016401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.025210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.025951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.026338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.026685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.027535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.029477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.042041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 928/1860] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:01 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:02.045988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.062089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c182c5-a6b6-4219-b71e-0a580e62000f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.065577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 933/1861] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:01 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:02.068424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.069244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.069526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.069942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.070212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.070851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.072885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.086921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 929/1862] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:02.091158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.102065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b6037-6abf-473e-8052-c8b819909879 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.138571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:02.167763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda62c9-8bc6-4e74-be15-1f79935b050e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.170910 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.172266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.172648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.173056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.174055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.174436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.175104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.175384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.175661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.176782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.176909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.179477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.191317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 930/1863] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:02.191317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.191317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:02.213124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 934/1864] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:02.213124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.220295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb015f8-2b60-4b28-8060-c88ae0ecac0c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.222270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af5d23-4973-4dc9-ba86-cd8df39c3355 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.225627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.226282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.226571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.226852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] PATH_INFO: `/v3/projects/629c145163e84203ad54643c93902f8e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.227763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.228030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629c145163e84203ad54643c93902f8e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.228515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.228798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.229071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] PATH_INFO: `/v3/projects/ffecbf309e8e4e5982df25f256f4bebf/users/5a829cfd772240dc934a8c8d779f7a43/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.229992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.248300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffecbf309e8e4e5982df25f256f4bebf, user_id=5a829cfd772240dc934a8c8d779f7a43, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.251963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.252461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:02.279163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 935/1865] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:02 2022] PUT /identity/v3/projects/ffecbf309e8e4e5982df25f256f4bebf/users/5a829cfd772240dc934a8c8d779f7a43/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:02.279163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.300975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629c145163e84203ad54643c93902f8e', 'request_id': 'req-aedc3899-3633-4239-b805-c2aba0d579d8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:02.308712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629c145163e84203ad54643c93902f8e', 'request_id': 'req-aedc3899-3633-4239-b805-c2aba0d579d8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:02.319230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629c145163e84203ad54643c93902f8e', 'request_id': 'req-aedc3899-3633-4239-b805-c2aba0d579d8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:02.336818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] The token cache is being invalidate because project 629c145163e84203ad54643c93902f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:02.337132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:02.338130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-aedc3899-3633-4239-b805-c2aba0d579d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:02.340458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 931/1866] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:02 2022] DELETE /identity/v3/projects/629c145163e84203ad54643c93902f8e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:02.341889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.342175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.342448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.356270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d434c36-45d7-4c62-a375-ad5218301a4d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.380874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] MFA Rules not processed for user `5a829cfd772240dc934a8c8d779f7a43`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:02.382281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:02.421070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a7199-88bf-455a-981a-e38cb39908d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.421857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a7199-88bf-455a-981a-e38cb39908d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.422248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a7199-88bf-455a-981a-e38cb39908d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.422699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a7199-88bf-455a-981a-e38cb39908d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.423355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a7199-88bf-455a-981a-e38cb39908d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.425038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a7199-88bf-455a-981a-e38cb39908d7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.435330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 936/1867] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:02.436580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.436864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.437704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.458984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:02.460870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:02.465367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 932/1868] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:02.466035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.467374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:02.476744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 937/1869] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:02.479346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.480894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:02.489401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d0784-dae1-4fed-9a67-1b4574e08b47 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.507832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e9a8e-5cef-40f0-b57f-aaabd6b5d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.507832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9a8e-5cef-40f0-b57f-aaabd6b5d027 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.507832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9a8e-5cef-40f0-b57f-aaabd6b5d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.508439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf39c02-0fb3-487d-a0e6-4a83d5570943 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.508535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e9a8e-5cef-40f0-b57f-aaabd6b5d027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.508535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e9a8e-5cef-40f0-b57f-aaabd6b5d027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.508535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e9a8e-5cef-40f0-b57f-aaabd6b5d027 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.508744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.508744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.508744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.508744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.509051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.509051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.526554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 933/1870] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:02.527440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80161-64f9-48e3-9409-9cafa0415d03 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.527787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80161-64f9-48e3-9409-9cafa0415d03 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.528107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80161-64f9-48e3-9409-9cafa0415d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.544924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 938/1871] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:02.544924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.552898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7eb80161-64f9-48e3-9409-9cafa0415d03 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:02.554573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7eb80161-64f9-48e3-9409-9cafa0415d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:02.565567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:02.615957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdef583-ed46-4b82-8fc4-ac6b1d41b119 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.622438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.623463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.623759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.624064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] PATH_INFO: `/v3/projects/f8aae12250cd4dcf83eb0deecfe635e8/users/544533cc1d0a422f9b6c0742ca03e6dd/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.635449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 934/1872] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:02.635449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80161-64f9-48e3-9409-9cafa0415d03 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.640442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8aae12250cd4dcf83eb0deecfe635e8, user_id=544533cc1d0a422f9b6c0742ca03e6dd, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.643285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.645827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80161-64f9-48e3-9409-9cafa0415d03 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.652204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458636b-9b9f-4cb7-8f63-60bfde9ab7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.652911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458636b-9b9f-4cb7-8f63-60bfde9ab7fc admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.653963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458636b-9b9f-4cb7-8f63-60bfde9ab7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.654340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458636b-9b9f-4cb7-8f63-60bfde9ab7fc admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.655278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458636b-9b9f-4cb7-8f63-60bfde9ab7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.658221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458636b-9b9f-4cb7-8f63-60bfde9ab7fc admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.662568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 939/1873] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:02 2022] PUT /identity/v3/projects/f8aae12250cd4dcf83eb0deecfe635e8/users/544533cc1d0a422f9b6c0742ca03e6dd/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:02.672894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.686251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 935/1874] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/users => generated 301 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:02.687913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53240e-9717-4b63-bfc9-003f23a074e9 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.688450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53240e-9717-4b63-bfc9-003f23a074e9 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.688828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53240e-9717-4b63-bfc9-003f23a074e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.706161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:02.727757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-3a53240e-9717-4b63-bfc9-003f23a074e9 None None] MFA Rules not processed for user `544533cc1d0a422f9b6c0742ca03e6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:02.727757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3a53240e-9717-4b63-bfc9-003f23a074e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:02.803284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37544d87-f72c-4951-8534-5ed36f5de3ef admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.831176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.832136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.832392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.833427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.841905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:02.842265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.845294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.862615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 940/1875] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:02.863633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.879715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1b836-0fec-4f2c-ae5d-8c9bb1c3513f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.893890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.894579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.894861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.895133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.895793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.897452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.933439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 941/1876] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:02.935885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:02.952102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecafe-aab9-46ab-94d2-cda28abb891e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:02.959167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:02.959795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:02.960345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:02.960727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:02.961399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:02.966073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:02.986679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 936/1877] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:02.987608 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53240e-9717-4b63-bfc9-003f23a074e9 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.004751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53240e-9717-4b63-bfc9-003f23a074e9 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.011740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.012464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.012851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.013225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] PATH_INFO: `/v3/projects/91d1c47f393d4347b79abd3c2acf6867/users/061bfa4e347c490cba640328ae854b89/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.025541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 942/1878] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:02 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:03.025541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.047946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d1c47f393d4347b79abd3c2acf6867, user_id=061bfa4e347c490cba640328ae854b89, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.051178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.068073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 937/1879] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:02 2022] PUT /identity/v3/projects/91d1c47f393d4347b79abd3c2acf6867/users/061bfa4e347c490cba640328ae854b89/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:03.069205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.123366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad1cfe-d42f-4bd0-b5a1-c5cdd32ad7a3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.138870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:03.147840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a83-c99b-44f9-bf92-63fb5c321db0 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.153334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.153492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.153703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.153981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.154615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.156658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.181746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 938/1880] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:03 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:03.182895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.195429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1540f7-bde9-4ed8-aff1-1ad8cfe6f075 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.201468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.201639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.202088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.202356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.202465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.202624 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.202807 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.203173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.203406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.204572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.205362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.207144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.220300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 939/1881] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:03.221457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.232429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0cab-fc33-4111-a040-0537fd4eba2b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.238614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.239153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.239438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.239700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.240485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.241183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 943/1882] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:03 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:03.244223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.244312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.254485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 940/1883] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:03.255509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.266221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8112fa7-f940-4abb-9a9e-f20cef8dd920 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.306929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143cf0a-add4-4636-a2c0-ff739abeaa13 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.308984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:03.312204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.313253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.313573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.313760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] PATH_INFO: `/v3/projects/91d1c47f393d4347b79abd3c2acf6867/users/061bfa4e347c490cba640328ae854b89/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.315704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d1c47f393d4347b79abd3c2acf6867, user_id=061bfa4e347c490cba640328ae854b89, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.318427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.329485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c60951-c391-4fae-bf0b-f9c03ed7fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.329794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 944/1884] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:03 2022] PUT /identity/v3/projects/91d1c47f393d4347b79abd3c2acf6867/users/061bfa4e347c490cba640328ae854b89/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:03.330089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60951-c391-4fae-bf0b-f9c03ed7fba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.330381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60951-c391-4fae-bf0b-f9c03ed7fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.330600 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.330692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c60951-c391-4fae-bf0b-f9c03ed7fba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.331265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60951-c391-4fae-bf0b-f9c03ed7fba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.333205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c60951-c391-4fae-bf0b-f9c03ed7fba4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.356411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 941/1885] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:03 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:03.357645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7704a-73d2-4dc2-bfd8-63a2937eff24 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.357928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7704a-73d2-4dc2-bfd8-63a2937eff24 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.358198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7704a-73d2-4dc2-bfd8-63a2937eff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.386340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-aca7704a-73d2-4dc2-bfd8-63a2937eff24 None None] MFA Rules not processed for user `061bfa4e347c490cba640328ae854b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:03.387819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-aca7704a-73d2-4dc2-bfd8-63a2937eff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:03.407607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ffa4d-0706-4038-a38a-111bb08908d9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.412553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.413159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.413439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.413714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.414366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.416039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.428073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 945/1886] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:03.429087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.442512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c494ea-33a9-4e82-ad7f-06b4bef82e89 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.452252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.452252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.452527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.453341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.454578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.456766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.470178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 946/1887] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:03.471009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.477285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 942/1888] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:03.478309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7704a-73d2-4dc2-bfd8-63a2937eff24 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.486411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9186-08f7-4657-b8bb-0809a693f007 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.491574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.492221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.492592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.492897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] PATH_INFO: `/v3/projects/51565950c876407ab54d1af7018353fc/users/9ed112bad3ec4659a1b285461b937840/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.495077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7704a-73d2-4dc2-bfd8-63a2937eff24 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.502269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ff6e8-8119-4bf9-bc22-3561ae8ebac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.503725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ff6e8-8119-4bf9-bc22-3561ae8ebac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.505231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ff6e8-8119-4bf9-bc22-3561ae8ebac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.505534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ff6e8-8119-4bf9-bc22-3561ae8ebac0 admin admin] PATH_INFO: `/v3/projects/04d4d71fbbfe4a92bbfef139584c1db5/users/80e108f39202455b8c6983fcc8476f8d/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.508225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:03.519281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51565950c876407ab54d1af7018353fc, user_id=9ed112bad3ec4659a1b285461b937840, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.524294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.534659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ff6e8-8119-4bf9-bc22-3561ae8ebac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d4d71fbbfe4a92bbfef139584c1db5, user_id=80e108f39202455b8c6983fcc8476f8d, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.538431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ff6e8-8119-4bf9-bc22-3561ae8ebac0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.549114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 947/1889] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:03 2022] PUT /identity/v3/projects/51565950c876407ab54d1af7018353fc/users/9ed112bad3ec4659a1b285461b937840/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:03.550343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.562708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:03.572890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 943/1890] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:03 2022] PUT /identity/v3/projects/04d4d71fbbfe4a92bbfef139584c1db5/users/80e108f39202455b8c6983fcc8476f8d/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:03.576694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893bb0d-cbf0-462b-83c1-24d5483c3f7a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.577546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893bb0d-cbf0-462b-83c1-24d5483c3f7a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.580562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893bb0d-cbf0-462b-83c1-24d5483c3f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.633367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2893bb0d-cbf0-462b-83c1-24d5483c3f7a None None] MFA Rules not processed for user `9ed112bad3ec4659a1b285461b937840`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:03.635065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2893bb0d-cbf0-462b-83c1-24d5483c3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:03.676973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9a7fc-74e1-464d-a036-76dcafa32bf8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.745175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.745712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.745995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.746275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.748304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 944/1891] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:03.749606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893bb0d-cbf0-462b-83c1-24d5483c3f7a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.772824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:03.811115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.813532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.820217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893bb0d-cbf0-462b-83c1-24d5483c3f7a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.826799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 948/1892] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:03.826799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.826799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:03.829322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.829985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.830270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.830549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.831215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.832932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.842756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea9c2e-4356-45c4-9abe-066e5bf20999 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.843968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 945/1893] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:03.848142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.848535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.849150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.849583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.849816 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.859087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1167-015f-43db-9c1e-41566d39463e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.859635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.861304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.864069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f34c3-bd6c-4bea-a1e7-04faf0b586f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.864943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f34c3-bd6c-4bea-a1e7-04faf0b586f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.865305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f34c3-bd6c-4bea-a1e7-04faf0b586f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.865659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f34c3-bd6c-4bea-a1e7-04faf0b586f7 admin admin] PATH_INFO: `/v3/projects/04d4d71fbbfe4a92bbfef139584c1db5/users/80e108f39202455b8c6983fcc8476f8d/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.867834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f34c3-bd6c-4bea-a1e7-04faf0b586f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d4d71fbbfe4a92bbfef139584c1db5, user_id=80e108f39202455b8c6983fcc8476f8d, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:03.870570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 949/1894] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:03.870777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f34c3-bd6c-4bea-a1e7-04faf0b586f7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:03.893857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 946/1895] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:03 2022] PUT /identity/v3/projects/04d4d71fbbfe4a92bbfef139584c1db5/users/80e108f39202455b8c6983fcc8476f8d/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:03.901088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:03.903940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f806-8f39-42ad-8f06-0964f20b5e83 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.904239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f806-8f39-42ad-8f06-0964f20b5e83 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.904517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f806-8f39-42ad-8f06-0964f20b5e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.915201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58ba35-5745-4e4c-8b74-1b491f0bcae7 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:03.935259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-78b6f806-8f39-42ad-8f06-0964f20b5e83 None None] MFA Rules not processed for user `80e108f39202455b8c6983fcc8476f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:03.937848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-78b6f806-8f39-42ad-8f06-0964f20b5e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:03.963326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:03.976539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:03.977277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:03.977561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:03.978350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:03.979897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:04.027892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 947/1896] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:04.063797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:04.065706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:04.079990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 950/1897] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:04.180962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f806-8f39-42ad-8f06-0964f20b5e83 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:04.194638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f806-8f39-42ad-8f06-0964f20b5e83 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:04.198977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:04.199884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:04.200442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:04.200974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:04.213306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:04.215178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:04.227679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 948/1898] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:04.461853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:04.471177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a295-e3d7-4844-8826-84c407d0f57b service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:04.475309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec5701-8cb3-4bcf-8b96-3e71f859e69a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:04.475959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5701-8cb3-4bcf-8b96-3e71f859e69a service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:04.476243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5701-8cb3-4bcf-8b96-3e71f859e69a service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:04.476523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec5701-8cb3-4bcf-8b96-3e71f859e69a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:04.536869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec5701-8cb3-4bcf-8b96-3e71f859e69a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:04.538359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec5701-8cb3-4bcf-8b96-3e71f859e69a service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:04.548410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 951/1899] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:04.628078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:04.732404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab046bb-b8bc-4be8-8175-f8712d397464 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:04.737510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:04.738841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:04.739200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:04.739482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] PATH_INFO: `/v3/users/5a829cfd772240dc934a8c8d779f7a43` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:04.740776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a829cfd772240dc934a8c8d779f7a43)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:04.742970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:04.779973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:04.879080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a829cfd772240dc934a8c8d779f7a43'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:04.879912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a829cfd772240dc934a8c8d779f7a43'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:04.880593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a829cfd772240dc934a8c8d779f7a43'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:04.897544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a829cfd772240dc934a8c8d779f7a43'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:04.905464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a829cfd772240dc934a8c8d779f7a43'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:04.923075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 949/1900] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:04 2022] DELETE /identity/v3/users/5a829cfd772240dc934a8c8d779f7a43 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:04.927843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:04.928496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:04.928893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:04.955743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:04.957146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.032238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:05.033514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.038001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 952/1901] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:05.047953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:05.049474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.050724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018545d-a0de-4bcb-90d0-a4df176c17f4 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:05.056365 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:05.057154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:05.057440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:05.057717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] PATH_INFO: `/v3/users/544533cc1d0a422f9b6c0742ca03e6dd` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:05.058871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544533cc1d0a422f9b6c0742ca03e6dd)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:05.060845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:05.090669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:05.111379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544533cc1d0a422f9b6c0742ca03e6dd'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.112081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544533cc1d0a422f9b6c0742ca03e6dd'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.112857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544533cc1d0a422f9b6c0742ca03e6dd'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.116958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81306c-96c2-49c6-bfbb-fe7bf0919837 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:05.120951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:05.121557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:05.121832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:05.122104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:05.124151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.126332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544533cc1d0a422f9b6c0742ca03e6dd'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.134142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b6f65a73-1699-4c47-9c2d-c6c3778e6e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544533cc1d0a422f9b6c0742ca03e6dd'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.137291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:05.138879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:05.147748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 950/1902] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:05 2022] DELETE /identity/v3/users/544533cc1d0a422f9b6c0742ca03e6dd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:05.152094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:05.152390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:05.152512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 953/1903] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:05.156694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:05.175620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:05.176971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.244782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 951/1904] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:05.255523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:05.256971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.268789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb822-3d57-4cb2-8e3d-5dbac203e0fd service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:05.320343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:05.320955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:05.321231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:05.321562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:05.331555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:05.333058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:05.343830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 954/1905] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:05.701869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:05.703696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.715526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458c870-9c3c-430f-800e-fc799fdba5d2 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:05.721597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:05.723554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:05.725417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:05.726050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] PATH_INFO: `/v3/projects/ffecbf309e8e4e5982df25f256f4bebf` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:05.727532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffecbf309e8e4e5982df25f256f4bebf)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:05.730307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:05.732660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:05.786820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffecbf309e8e4e5982df25f256f4bebf', 'request_id': 'req-afd96605-7223-4e70-8f2c-1471e745b111'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.797300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffecbf309e8e4e5982df25f256f4bebf', 'request_id': 'req-afd96605-7223-4e70-8f2c-1471e745b111'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.806447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffecbf309e8e4e5982df25f256f4bebf', 'request_id': 'req-afd96605-7223-4e70-8f2c-1471e745b111'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.828943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] The token cache is being invalidate because project ffecbf309e8e4e5982df25f256f4bebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:05.829238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.832144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:05.834271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 952/1906] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:05 2022] DELETE /identity/v3/projects/ffecbf309e8e4e5982df25f256f4bebf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:05.839733 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:05.850629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b064d5c-ac68-48eb-95a1-88fd8653f2b9 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:05.871681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:05.873128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:05.949809 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:05.950451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:05.950729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:05.951031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] PATH_INFO: `/v3/users/061bfa4e347c490cba640328ae854b89` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:05.952360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=061bfa4e347c490cba640328ae854b89)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:05.955829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:05.970755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd96605-7223-4e70-8f2c-1471e745b111 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:05.978658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:05.979309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:05.979595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:05.979923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] PATH_INFO: `/v3/projects/f8aae12250cd4dcf83eb0deecfe635e8` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:05.981073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8aae12250cd4dcf83eb0deecfe635e8)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:05.982995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:06.008422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061bfa4e347c490cba640328ae854b89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.017864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061bfa4e347c490cba640328ae854b89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.018437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061bfa4e347c490cba640328ae854b89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.033804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061bfa4e347c490cba640328ae854b89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.037602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8aae12250cd4dcf83eb0deecfe635e8', 'request_id': 'req-5aced03e-7f97-46bc-82d0-c750439fdefa'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.038260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:06.044154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061bfa4e347c490cba640328ae854b89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.044884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8aae12250cd4dcf83eb0deecfe635e8', 'request_id': 'req-5aced03e-7f97-46bc-82d0-c750439fdefa'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.052556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 955/1907] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:05 2022] DELETE /identity/v3/users/061bfa4e347c490cba640328ae854b89 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:06.055823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8aae12250cd4dcf83eb0deecfe635e8', 'request_id': 'req-5aced03e-7f97-46bc-82d0-c750439fdefa'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.068587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] The token cache is being invalidate because project f8aae12250cd4dcf83eb0deecfe635e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:06.068883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.069609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.071317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 953/1908] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:05 2022] DELETE /identity/v3/projects/f8aae12250cd4dcf83eb0deecfe635e8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:06.075533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:06.077116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:06.149114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58a02-fd33-470f-9fae-5c23fda367c1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:06.153854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:06.154709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.154989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.155263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] PATH_INFO: `/v3/users/80e108f39202455b8c6983fcc8476f8d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.156556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e108f39202455b8c6983fcc8476f8d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:06.158535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:06.206105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e108f39202455b8c6983fcc8476f8d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.213343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e108f39202455b8c6983fcc8476f8d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.214117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e108f39202455b8c6983fcc8476f8d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.230274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e108f39202455b8c6983fcc8476f8d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.238886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e108f39202455b8c6983fcc8476f8d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.245127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 956/1909] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:06 2022] DELETE /identity/v3/users/80e108f39202455b8c6983fcc8476f8d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:06.543193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:06.544704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:06.572693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:06.633930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:06.635502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:06.638176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aced03e-7f97-46bc-82d0-c750439fdefa admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:06.704691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:06.705410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.705779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.706116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] PATH_INFO: `/v3/projects/91d1c47f393d4347b79abd3c2acf6867` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.707525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d1c47f393d4347b79abd3c2acf6867)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:06.709534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:06.726185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89814461-2dc9-424a-98b5-0aee40b029eb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:06.731301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:06.732060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.732422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.732776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] PATH_INFO: `/v3/projects/04d4d71fbbfe4a92bbfef139584c1db5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.734723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d4d71fbbfe4a92bbfef139584c1db5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:06.736768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:06.756585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:06.773557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d1c47f393d4347b79abd3c2acf6867', 'request_id': 'req-335e8276-bb06-48dc-ae86-434645f4853d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.781540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d1c47f393d4347b79abd3c2acf6867', 'request_id': 'req-335e8276-bb06-48dc-ae86-434645f4853d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.791736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d1c47f393d4347b79abd3c2acf6867', 'request_id': 'req-335e8276-bb06-48dc-ae86-434645f4853d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.792668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d4d71fbbfe4a92bbfef139584c1db5', 'request_id': 'req-893268ce-2a99-414f-bbda-a677090a0655'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.800976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d4d71fbbfe4a92bbfef139584c1db5', 'request_id': 'req-893268ce-2a99-414f-bbda-a677090a0655'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.806773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] The token cache is being invalidate because project 91d1c47f393d4347b79abd3c2acf6867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:06.807098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.808032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335e8276-bb06-48dc-ae86-434645f4853d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.810027 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 954/1910] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:06 2022] DELETE /identity/v3/projects/91d1c47f393d4347b79abd3c2acf6867 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:06.813558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d4d71fbbfe4a92bbfef139584c1db5', 'request_id': 'req-893268ce-2a99-414f-bbda-a677090a0655'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.815458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca813d0-3891-4eff-aa00-90244979e18e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.815740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca813d0-3891-4eff-aa00-90244979e18e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.816047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca813d0-3891-4eff-aa00-90244979e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.834813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] The token cache is being invalidate because project 04d4d71fbbfe4a92bbfef139584c1db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:06.835113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.835839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-893268ce-2a99-414f-bbda-a677090a0655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:06.839891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 957/1911] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:06 2022] DELETE /identity/v3/projects/04d4d71fbbfe4a92bbfef139584c1db5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:06.842568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-3ca813d0-3891-4eff-aa00-90244979e18e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:06.843790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b589ec-3bda-46b2-95ce-79cee0e24257 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.844117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b589ec-3bda-46b2-95ce-79cee0e24257 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.844491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3ca813d0-3891-4eff-aa00-90244979e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:06.844619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b589ec-3bda-46b2-95ce-79cee0e24257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.867442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b3b589ec-3bda-46b2-95ce-79cee0e24257 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:06.868887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b3b589ec-3bda-46b2-95ce-79cee0e24257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:06.902918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:06.919852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 955/1912] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:06.921514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2edfd-a397-4ad9-bbfb-6524a6a77d5b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.921953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2edfd-a397-4ad9-bbfb-6524a6a77d5b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.922449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2edfd-a397-4ad9-bbfb-6524a6a77d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.942646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-afb2edfd-a397-4ad9-bbfb-6524a6a77d5b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:06.943917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-afb2edfd-a397-4ad9-bbfb-6524a6a77d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:06.945814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 958/1913] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:06.947230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c65128-0cf5-40cd-92e7-5038157649cc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.947597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c65128-0cf5-40cd-92e7-5038157649cc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.947984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c65128-0cf5-40cd-92e7-5038157649cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.951857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 956/1914] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:06.957697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2edfd-a397-4ad9-bbfb-6524a6a77d5b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:06.969570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2edfd-a397-4ad9-bbfb-6524a6a77d5b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:06.970656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c2c65128-0cf5-40cd-92e7-5038157649cc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:06.971900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c2c65128-0cf5-40cd-92e7-5038157649cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:06.975408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:06.976078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:06.976484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:06.976765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:06.977669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:06.977985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:06.980209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:06.982491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 959/1915] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:06.986568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c65128-0cf5-40cd-92e7-5038157649cc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:06.993517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 957/1916] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:16:06.997729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:06.998411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c65128-0cf5-40cd-92e7-5038157649cc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.005817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.006531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.006822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.007162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.008023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:07.008392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.009912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503379b4-974e-4332-8d45-9856ff8ea0e7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.010019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.016184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.017019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.017368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.017730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.018436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.020560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.023849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 960/1917] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:16:07.028236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.039640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f0b4-1c72-4504-937a-9275b4d4f88f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.046018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.047029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.047326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.047623 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.048329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.050311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.058708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 958/1918] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:06 2022] POST /identity/v3/projects => generated 357 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:07.063356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.088975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 961/1919] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:07 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:07.093074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.138266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fc7fa-4407-4b55-81aa-b5ed9604480a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.160124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ac70c-f5e2-4c40-89f0-277025672a8b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.165129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.165938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.166301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.166585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.167231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.169325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.181923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:07.197771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 962/1920] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:07 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:07.200650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.201507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.202159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.202474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.203353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.204008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.205951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.211336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a84b2-aaa7-4048-a911-b3c6c5a034d8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.216054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.216648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.216932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.217207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.217907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.220737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.230543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 959/1921] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:07 2022] POST /identity/v3/users => generated 279 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:07.234384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 963/1922] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:07.234543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.235360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.244436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62c3fb-e5cc-4f3c-97de-c1e588c8c6b9 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.244978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b557-b443-4a3f-b087-7dfb47720f39 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.249514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.249751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.250266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.250369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.250615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.250715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.250891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.251130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.251531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.252007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.253397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.253607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.263877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 960/1923] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:07.264800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 964/1924] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:07.268411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.269618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.278780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63863f2d-95af-42d2-90b0-9bf4501052bd admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.279420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682ff27-d133-42be-aa66-1475dce1f41e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.284832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6061995-ca1f-4fa1-bff3-0d84283b7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.285065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.285488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6061995-ca1f-4fa1-bff3-0d84283b7fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.285770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6061995-ca1f-4fa1-bff3-0d84283b7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.286049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6061995-ca1f-4fa1-bff3-0d84283b7fcb admin admin] PATH_INFO: `/v3/projects/d51168103dd84666992f3fcc7d516d32/users/b5c693872cbf459aaeaeefacd33a717c/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.286311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.286762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.287171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.288063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.289893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.301957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6061995-ca1f-4fa1-bff3-0d84283b7fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51168103dd84666992f3fcc7d516d32, user_id=b5c693872cbf459aaeaeefacd33a717c, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.302571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 961/1925] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:07.305073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6061995-ca1f-4fa1-bff3-0d84283b7fcb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.306384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.317272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919206-c63c-4ef7-abe4-a9c05b00c6f0 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.320409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 965/1926] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:07 2022] PUT /identity/v3/projects/d51168103dd84666992f3fcc7d516d32/users/b5c693872cbf459aaeaeefacd33a717c/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:07.325383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.325676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.325975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.347497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:07.348757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:07.361380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:07.410043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24af63d-7744-4cba-b798-f2f3a7d913f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.410730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af63d-7744-4cba-b798-f2f3a7d913f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.411010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af63d-7744-4cba-b798-f2f3a7d913f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.411286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af63d-7744-4cba-b798-f2f3a7d913f4 admin admin] PATH_INFO: `/v3/projects/1fbd05ea19204726b07142bdf266e212/users/397cc6b811a14f35bc560c729f5460b2/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.435707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24af63d-7744-4cba-b798-f2f3a7d913f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbd05ea19204726b07142bdf266e212, user_id=397cc6b811a14f35bc560c729f5460b2, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.439303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24af63d-7744-4cba-b798-f2f3a7d913f4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.450360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 966/1927] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:07.460725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 962/1928] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:07 2022] PUT /identity/v3/projects/1fbd05ea19204726b07142bdf266e212/users/397cc6b811a14f35bc560c729f5460b2/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:07.461090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.464884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:07.471919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.472209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.472613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.512102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] MFA Rules not processed for user `397cc6b811a14f35bc560c729f5460b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:07.513578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:07.529233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2736be-1e77-408b-8f07-9f2b0535404c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.581644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.582179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.582465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.582746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.584016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 963/1929] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:07.602706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:07.636010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.637964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:07.698541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.705899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.726562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 967/1930] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:07.750248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c07231-75f0-46e5-8c0e-412db80190eb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.756639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32f7b-7cac-4be6-9768-4e537ecfcb53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.757790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32f7b-7cac-4be6-9768-4e537ecfcb53 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.758357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32f7b-7cac-4be6-9768-4e537ecfcb53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.758952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32f7b-7cac-4be6-9768-4e537ecfcb53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.776156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32f7b-7cac-4be6-9768-4e537ecfcb53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.779107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32f7b-7cac-4be6-9768-4e537ecfcb53 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.795901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 964/1931] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:07.817578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:07.846782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532525a-7b92-443a-907f-5494a0c25b51 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:07.855968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:07.856882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.857215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.857497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] PATH_INFO: `/v3/users/397cc6b811a14f35bc560c729f5460b2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.858651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397cc6b811a14f35bc560c729f5460b2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:07.861041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:07.918676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397cc6b811a14f35bc560c729f5460b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:07.927180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397cc6b811a14f35bc560c729f5460b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:07.927956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397cc6b811a14f35bc560c729f5460b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:07.941668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397cc6b811a14f35bc560c729f5460b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:07.949019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397cc6b811a14f35bc560c729f5460b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:07.955719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 968/1932] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:07 2022] DELETE /identity/v3/users/397cc6b811a14f35bc560c729f5460b2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:07.960192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:07.960481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:07.960758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:07.987879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:07.988599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:08.038770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:08.057647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 965/1933] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:08.068168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:08.069651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:08.138040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fc8f4-83e8-437b-b464-5852d1e2e1a2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:08.144264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64df86-9a4e-4cd3-8647-626a838a13d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:08.145469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64df86-9a4e-4cd3-8647-626a838a13d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:08.145969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64df86-9a4e-4cd3-8647-626a838a13d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:08.146459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64df86-9a4e-4cd3-8647-626a838a13d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:08.161556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64df86-9a4e-4cd3-8647-626a838a13d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:08.163561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64df86-9a4e-4cd3-8647-626a838a13d0 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:08.176289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 969/1934] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:08.838838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:08.840386 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:08.854861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b9f5-ef11-4745-b9fd-159b56d3d93d None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:08.875434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:08.876315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:08.876611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:08.877043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] PATH_INFO: `/v3/projects/1fbd05ea19204726b07142bdf266e212` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:08.878327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fbd05ea19204726b07142bdf266e212)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:08.880295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:08.946084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fbd05ea19204726b07142bdf266e212', 'request_id': 'req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:08.953762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fbd05ea19204726b07142bdf266e212', 'request_id': 'req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:08.961093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:08.961661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:08.961741 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:08.963065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fbd05ea19204726b07142bdf266e212', 'request_id': 'req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:08.978707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] The token cache is being invalidate because project 1fbd05ea19204726b07142bdf266e212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:08.979074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:08.979855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a2dd9bfa-5e5d-4b50-b64c-e0e57485f66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:08.986476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 966/1935] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:08 2022] DELETE /identity/v3/projects/1fbd05ea19204726b07142bdf266e212 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:08.988007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaf282-9e57-40c2-be50-5c90f813b825 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:08.988296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaf282-9e57-40c2-be50-5c90f813b825 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:08.991394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaf282-9e57-40c2-be50-5c90f813b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.005440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] MFA Rules not processed for user `b5c693872cbf459aaeaeefacd33a717c`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:09.007559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:09.019118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-badaf282-9e57-40c2-be50-5c90f813b825 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:09.019781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-badaf282-9e57-40c2-be50-5c90f813b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:09.036384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:09.117588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 970/1936] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:09.118828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 967/1937] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:09.127949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.128267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9a44-0db1-4eb8-ab6e-00c325124ceb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.128557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9a44-0db1-4eb8-ab6e-00c325124ceb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.128830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa9a44-0db1-4eb8-ab6e-00c325124ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.129721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:09.150421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec6bf5-7240-4c4b-8f83-f55e8bbaefee None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.153682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-74aa9a44-0db1-4eb8-ab6e-00c325124ceb None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:09.155088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-74aa9a44-0db1-4eb8-ab6e-00c325124ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:09.156084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.156851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.157130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.157408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.158095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.160348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.173222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 968/1938] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:09.174194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa9a44-0db1-4eb8-ab6e-00c325124ceb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.184284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa9a44-0db1-4eb8-ab6e-00c325124ceb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.189936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.190564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.190850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.191125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.191785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:09.192126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.193881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.207939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 969/1939] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:09.212400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.227919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e873ee-8bae-4759-bed3-4cd7f0c4c2f8 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.241036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 971/1940] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:09.241245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.241703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.241997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.242170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.242274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.242898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.245204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.292877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 970/1941] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:09.297758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.353514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd313c-a4ba-4b27-81f3-6ddc59702aeb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.356948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:09.403676 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1b169-9e74-4c5a-8a06-dfd90f8af4bf admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.417636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.418267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.418564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.418885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.419516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.422411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.440160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.440761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.441103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.441436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.442122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.444292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.451528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 971/1942] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:09.455624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.467665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449b380-98c5-40cc-a78b-9790681e1701 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.472101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 972/1943] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:09.476083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.476250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.476698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.476980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.477257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.477907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.479554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.487013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9596e-94e7-4312-895f-2156dc0f7b2f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.493762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 972/1944] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:09.493894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.493894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.493894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.493894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.494245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.494741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.495451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.505281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b834c28-5382-47dc-8cb0-249177afd53a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.506824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 973/1945] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:09.510520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.510889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.511173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.511463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.511739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.512444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.514051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.521234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54c988-2320-42e4-9350-8b776911b5a1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.528566 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 973/1946] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:09.528688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.528688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.528688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.528688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] PATH_INFO: `/v3/projects/1b0cdbdb2fca46e6a8f007dbe9dd9ec8/users/3fd2211d423a4baa9981955b248e9727/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.529350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.539553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe935-87ee-44ad-b582-8d010e618fa8 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.542697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0cdbdb2fca46e6a8f007dbe9dd9ec8, user_id=3fd2211d423a4baa9981955b248e9727, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.544194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70380b-ebf6-48eb-8234-0e98ce6ff9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.544843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70380b-ebf6-48eb-8234-0e98ce6ff9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.545124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70380b-ebf6-48eb-8234-0e98ce6ff9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.545360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.545463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70380b-ebf6-48eb-8234-0e98ce6ff9af admin admin] PATH_INFO: `/v3/projects/99532df9831a4fbc9cd985101a6c1de6/users/ca3bd352e4e94a038142068b4bc99820/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.553676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:09.559958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 974/1947] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:09 2022] PUT /identity/v3/projects/1b0cdbdb2fca46e6a8f007dbe9dd9ec8/users/3fd2211d423a4baa9981955b248e9727/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:09.562212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70380b-ebf6-48eb-8234-0e98ce6ff9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=99532df9831a4fbc9cd985101a6c1de6, user_id=ca3bd352e4e94a038142068b4bc99820, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.563663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.565306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70380b-ebf6-48eb-8234-0e98ce6ff9af admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.579669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 974/1948] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:09 2022] PUT /identity/v3/projects/99532df9831a4fbc9cd985101a6c1de6/users/ca3bd352e4e94a038142068b4bc99820/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:09.590133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae8aa-ca98-4e6e-b918-0949b13db5e5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.590424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae8aa-ca98-4e6e-b918-0949b13db5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.591106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae8aa-ca98-4e6e-b918-0949b13db5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.620359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7ccae8aa-ca98-4e6e-b918-0949b13db5e5 None None] MFA Rules not processed for user `ca3bd352e4e94a038142068b4bc99820`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:09.621582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7ccae8aa-ca98-4e6e-b918-0949b13db5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:09.627212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf9a26-41e2-4440-8341-54aa1a56ac01 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.684041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.684657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.684939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.685217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.688976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 975/1949] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:09.689143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.689143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.689923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccae8aa-ca98-4e6e-b918-0949b13db5e5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.697569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 975/1950] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:09.701380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.702274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccae8aa-ca98-4e6e-b918-0949b13db5e5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.709509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.710207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.710492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.710952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.711868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f12eae-223d-4256-a466-d218771163f6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.712110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.714053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.716408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.717053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.717336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.717614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] PATH_INFO: `/v3/projects/1b0cdbdb2fca46e6a8f007dbe9dd9ec8/users/3fd2211d423a4baa9981955b248e9727/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.720591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0cdbdb2fca46e6a8f007dbe9dd9ec8, user_id=3fd2211d423a4baa9981955b248e9727, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.722964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.733562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 976/1951] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:09 2022] PUT /identity/v3/projects/1b0cdbdb2fca46e6a8f007dbe9dd9ec8/users/3fd2211d423a4baa9981955b248e9727/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:09.745776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 976/1952] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:09.746861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.821009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce8bae-928e-4524-9613-123b72f7ba21 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.862629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:09.892299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.892924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.893222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.893477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.894343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.896828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.927619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 977/1953] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:09 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:09.931588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.943521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90936b8f-ec12-44f7-a7fc-a65df195e268 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.948314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.948939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.949432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.949537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:09.950126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:09.951768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:09.964638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 977/1954] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:09.969182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:09.979611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c113e-20c9-4307-85b9-7b6d39553540 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:09.984261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:09.984933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:09.985211 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:09.985485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] PATH_INFO: `/v3/projects/00076df5d1e04d3fbf6b7eb8e1558c95/users/0ac8dc2ef365420aba1307224056fd9d/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:10.001723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00076df5d1e04d3fbf6b7eb8e1558c95, user_id=0ac8dc2ef365420aba1307224056fd9d, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:10.005451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:10.024563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 978/1955] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:09 2022] PUT /identity/v3/projects/00076df5d1e04d3fbf6b7eb8e1558c95/users/0ac8dc2ef365420aba1307224056fd9d/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:10.027412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:10.037573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bede0-7d6f-4759-a61d-09cd9a858465 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:10.065046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:10.101273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48695b8-48fa-4156-bcdf-d1877ee54e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:10.101917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48695b8-48fa-4156-bcdf-d1877ee54e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:10.102181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48695b8-48fa-4156-bcdf-d1877ee54e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:10.102455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48695b8-48fa-4156-bcdf-d1877ee54e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:10.103119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48695b8-48fa-4156-bcdf-d1877ee54e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:10.104769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48695b8-48fa-4156-bcdf-d1877ee54e00 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:10.116484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 978/1956] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:10.120734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:10.132998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9b1b6-34bd-4768-b577-bd2d4cfedd9f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:10.138767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:10.139447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:10.139729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:10.140133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] PATH_INFO: `/v3/projects/00076df5d1e04d3fbf6b7eb8e1558c95/users/0ac8dc2ef365420aba1307224056fd9d/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:10.149273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00076df5d1e04d3fbf6b7eb8e1558c95, user_id=0ac8dc2ef365420aba1307224056fd9d, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:10.152443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:10.174072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 979/1957] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:10 2022] PUT /identity/v3/projects/00076df5d1e04d3fbf6b7eb8e1558c95/users/0ac8dc2ef365420aba1307224056fd9d/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:10.184201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadced0-97b7-4ab3-a34d-485f5c76c420 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:10.184555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadced0-97b7-4ab3-a34d-485f5c76c420 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:10.184904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadced0-97b7-4ab3-a34d-485f5c76c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:10.220981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-bcadced0-97b7-4ab3-a34d-485f5c76c420 None None] MFA Rules not processed for user `0ac8dc2ef365420aba1307224056fd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:10.221948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bcadced0-97b7-4ab3-a34d-485f5c76c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:10.302948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 979/1958] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:10.314850 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:10.316570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:10.395383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7eb19-4ce8-4c44-b83f-d7d8fb60c769 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:10.401469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:10.404404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:10.404689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:10.404966 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:10.476686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:10.478057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:10.492435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 980/1959] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:10.634596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b26337-5734-4ca1-b237-9464245ec037 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:10.634890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b26337-5734-4ca1-b237-9464245ec037 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:10.635162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b26337-5734-4ca1-b237-9464245ec037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:10.665204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f3b26337-5734-4ca1-b237-9464245ec037 None None] MFA Rules not processed for user `3fd2211d423a4baa9981955b248e9727`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:10.669597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f3b26337-5734-4ca1-b237-9464245ec037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:10.768937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 980/1960] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:10.783819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:10.785736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:10.798837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0284a-f8c0-4d38-a4d3-74090cad5e96 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:10.815449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4717f9-5976-4925-89b6-90b8afb63421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:10.816265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4717f9-5976-4925-89b6-90b8afb63421 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:10.816603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4717f9-5976-4925-89b6-90b8afb63421 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:10.816877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4717f9-5976-4925-89b6-90b8afb63421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:10.887942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:10.906551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4717f9-5976-4925-89b6-90b8afb63421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:10.908012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4717f9-5976-4925-89b6-90b8afb63421 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:10.917631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 981/1961] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:12.290909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b26337-5734-4ca1-b237-9464245ec037 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:12.305897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b26337-5734-4ca1-b237-9464245ec037 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:12.309863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a82cd8-58e4-480b-a63f-47a4fb6a1a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:12.310490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82cd8-58e4-480b-a63f-47a4fb6a1a1d service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:12.310773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82cd8-58e4-480b-a63f-47a4fb6a1a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:12.311049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a82cd8-58e4-480b-a63f-47a4fb6a1a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:12.324567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a82cd8-58e4-480b-a63f-47a4fb6a1a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:12.326020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a82cd8-58e4-480b-a63f-47a4fb6a1a1d service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:12.336876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 981/1962] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:16.714589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346944ab-2913-4536-9d67-8e2f67ec4361 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:16.715144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346944ab-2913-4536-9d67-8e2f67ec4361 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:16.715144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346944ab-2913-4536-9d67-8e2f67ec4361 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:16.716542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 982/1963] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:16:16.725897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727065-0916-4686-87d1-9d5472eee0fd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:16.726507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727065-0916-4686-87d1-9d5472eee0fd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:16.726719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727065-0916-4686-87d1-9d5472eee0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:16.748896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-60727065-0916-4686-87d1-9d5472eee0fd None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:16.750107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-60727065-0916-4686-87d1-9d5472eee0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:16.768744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:16.818709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 982/1964] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:16:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:16.831899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346944ab-2913-4536-9d67-8e2f67ec4361 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:16.834502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-346944ab-2913-4536-9d67-8e2f67ec4361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:16.854567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346944ab-2913-4536-9d67-8e2f67ec4361 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:16.860776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085826f-eda9-4d90-954d-068e3d277c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:16.861394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085826f-eda9-4d90-954d-068e3d277c71 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:16.861676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085826f-eda9-4d90-954d-068e3d277c71 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:16.861953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085826f-eda9-4d90-954d-068e3d277c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:16.871139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085826f-eda9-4d90-954d-068e3d277c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:16.872745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085826f-eda9-4d90-954d-068e3d277c71 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:16.886154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 983/1965] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:26.808689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=21 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:26.879947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=15 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:27.090526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60727065-0916-4686-87d1-9d5472eee0fd None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:27.250538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60727065-0916-4686-87d1-9d5472eee0fd None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:27.263793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:27.264753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:27.265184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:27.266219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] PATH_INFO: `/v3/users/ca3bd352e4e94a038142068b4bc99820` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:27.267773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3bd352e4e94a038142068b4bc99820)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:27.277011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:27.393195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3bd352e4e94a038142068b4bc99820'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.394414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3bd352e4e94a038142068b4bc99820'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.397203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3bd352e4e94a038142068b4bc99820'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.433144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3bd352e4e94a038142068b4bc99820'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.448080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3bd352e4e94a038142068b4bc99820'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.489521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 983/1966] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:27 2022] DELETE /identity/v3/users/ca3bd352e4e94a038142068b4bc99820 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:27.494476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:27.495334 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:27.495796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:27.519653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:27.521154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:27.577140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:27.578750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:27.602100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 984/1967] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:27.612601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:27.614321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:27.656824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24e2cd-4984-4128-97e2-e9fb4019a471 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:27.662318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:27.663015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:27.663334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:27.663589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] PATH_INFO: `/v3/users/9ed112bad3ec4659a1b285461b937840` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:27.664772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed112bad3ec4659a1b285461b937840)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:27.666737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:27.683074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a28992-a9d2-4fbf-80aa-7c99b618077c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:27.686898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f42d7-6d33-45c0-8737-e20c6a977e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:27.688170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f42d7-6d33-45c0-8737-e20c6a977e27 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:27.688453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f42d7-6d33-45c0-8737-e20c6a977e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:27.688733 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f42d7-6d33-45c0-8737-e20c6a977e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:27.689995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:27.699366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f42d7-6d33-45c0-8737-e20c6a977e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:27.701053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f42d7-6d33-45c0-8737-e20c6a977e27 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:27.710970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 985/1968] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:27.722871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed112bad3ec4659a1b285461b937840'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.723557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed112bad3ec4659a1b285461b937840'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.724287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed112bad3ec4659a1b285461b937840'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.738783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed112bad3ec4659a1b285461b937840'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.746115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed112bad3ec4659a1b285461b937840'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:27.761132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 984/1969] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:27 2022] DELETE /identity/v3/users/9ed112bad3ec4659a1b285461b937840 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:27.765628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:27.765978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:27.766336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:27.786765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:27.788006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:27.881754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 986/1970] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:27.912083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:27.913714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:27.983717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283556-eb30-4bf2-8e82-b499d87d24d7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:27.990034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:27.990789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:27.990929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:27.991201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:28.002088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:28.003757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:28.022019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 985/1971] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:28.041571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:28.043063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:28.056139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2699b2-e26a-4eef-95fd-612bb67b84a8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:28.060829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:28.061532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:28.061814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:28.062084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] PATH_INFO: `/v3/projects/99532df9831a4fbc9cd985101a6c1de6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:28.064085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99532df9831a4fbc9cd985101a6c1de6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:28.065983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:28.132550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:28.151666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99532df9831a4fbc9cd985101a6c1de6', 'request_id': 'req-35e34d38-66bc-4a9c-93da-1e457acb2ef2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.163731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99532df9831a4fbc9cd985101a6c1de6', 'request_id': 'req-35e34d38-66bc-4a9c-93da-1e457acb2ef2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.177539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99532df9831a4fbc9cd985101a6c1de6', 'request_id': 'req-35e34d38-66bc-4a9c-93da-1e457acb2ef2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.191444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] The token cache is being invalidate because project 99532df9831a4fbc9cd985101a6c1de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:28.191738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.192501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.197362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 987/1972] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:28 2022] DELETE /identity/v3/projects/99532df9831a4fbc9cd985101a6c1de6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:28.199288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:28.211290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b82e0-2972-4648-9e34-411bcb33810f service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:28.299094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:28.300341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:28.300637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:28.301158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] PATH_INFO: `/v3/users/0ac8dc2ef365420aba1307224056fd9d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:28.302748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac8dc2ef365420aba1307224056fd9d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:28.305970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:28.385510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:28.389169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac8dc2ef365420aba1307224056fd9d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.391205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac8dc2ef365420aba1307224056fd9d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.392824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac8dc2ef365420aba1307224056fd9d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.420592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac8dc2ef365420aba1307224056fd9d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.435383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af6a4c06-a2f2-4102-9786-6643325768ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac8dc2ef365420aba1307224056fd9d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.438584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:28.440915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:28.481272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e34d38-66bc-4a9c-93da-1e457acb2ef2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:28.488695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:28.489237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:28.489585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:28.489851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] PATH_INFO: `/v3/projects/51565950c876407ab54d1af7018353fc` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:28.491168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=51565950c876407ab54d1af7018353fc)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:28.493708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:28.499353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 986/1973] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:28 2022] DELETE /identity/v3/users/0ac8dc2ef365420aba1307224056fd9d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:28.604348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51565950c876407ab54d1af7018353fc', 'request_id': 'req-3005acd0-0e10-447e-bed4-5dc45c8bf06a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.615433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51565950c876407ab54d1af7018353fc', 'request_id': 'req-3005acd0-0e10-447e-bed4-5dc45c8bf06a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.631370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51565950c876407ab54d1af7018353fc', 'request_id': 'req-3005acd0-0e10-447e-bed4-5dc45c8bf06a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.646587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] The token cache is being invalidate because project 51565950c876407ab54d1af7018353fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:28.647281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.650168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3005acd0-0e10-447e-bed4-5dc45c8bf06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:28.654204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 988/1974] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:28 2022] DELETE /identity/v3/projects/51565950c876407ab54d1af7018353fc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:28.659419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a79aa-060d-48b3-ac58-b36e0bd3c598 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:28.659967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a79aa-060d-48b3-ac58-b36e0bd3c598 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:28.660404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a79aa-060d-48b3-ac58-b36e0bd3c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:28.730122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1c9a79aa-060d-48b3-ac58-b36e0bd3c598 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:28.733977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1c9a79aa-060d-48b3-ac58-b36e0bd3c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:28.898106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 987/1975] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:28.902620 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27aa69-4707-422b-992f-ba33f8df4914 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:28.903401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27aa69-4707-422b-992f-ba33f8df4914 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:28.904188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27aa69-4707-422b-992f-ba33f8df4914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:28.934892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fe27aa69-4707-422b-992f-ba33f8df4914 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:28.936740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fe27aa69-4707-422b-992f-ba33f8df4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:28.949679 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 989/1976] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:28.954479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a79aa-060d-48b3-ac58-b36e0bd3c598 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:28.969444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a79aa-060d-48b3-ac58-b36e0bd3c598 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:28.981160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:28.981869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:28.982228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:28.982663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:28.983379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:28.983830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:28.986460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.005604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 988/1977] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:29.010090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27aa69-4707-422b-992f-ba33f8df4914 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.022427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27aa69-4707-422b-992f-ba33f8df4914 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.033236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.033954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.034326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.034495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.038723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.040851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.096768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.099268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.102169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 990/1978] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:29.103258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.126108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ad01e-4d2d-461b-9da1-082d6a8bf40b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.195289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ff9e-9acb-4742-a4ed-e1ec5db5ab67 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.213830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.214414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.214697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.214975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.218043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.218590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.220167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.220573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.220956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] PATH_INFO: `/v3/projects/00076df5d1e04d3fbf6b7eb8e1558c95` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.222197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.224629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00076df5d1e04d3fbf6b7eb8e1558c95)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.227558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.247842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 991/1979] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:29.250274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.268024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254e64b-971c-4bd4-b220-7e8065e8090d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.272141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.272838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.273185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.273605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.274105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.275684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.282673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=83,keystone:DELETE=11,keystone:INSERT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:29.284053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00076df5d1e04d3fbf6b7eb8e1558c95', 'request_id': 'req-9c84540b-c0b8-496b-9a94-9a4f08d932f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:29.285444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:29.291246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 992/1980] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:29.292275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00076df5d1e04d3fbf6b7eb8e1558c95', 'request_id': 'req-9c84540b-c0b8-496b-9a94-9a4f08d932f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:29.292397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.302914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00076df5d1e04d3fbf6b7eb8e1558c95', 'request_id': 'req-9c84540b-c0b8-496b-9a94-9a4f08d932f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:29.305258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba9d23-5773-4686-a87d-654393fd1df3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.316090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] The token cache is being invalidate because project 00076df5d1e04d3fbf6b7eb8e1558c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:29.316382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:29.317111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c84540b-c0b8-496b-9a94-9a4f08d932f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:29.318678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 989/1981] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:29 2022] DELETE /identity/v3/projects/00076df5d1e04d3fbf6b7eb8e1558c95 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:29.324194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb538-7b89-4b07-9cca-b4e5d88b9337 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.324194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb538-7b89-4b07-9cca-b4e5d88b9337 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.324194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bb538-7b89-4b07-9cca-b4e5d88b9337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.344402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-af9bb538-7b89-4b07-9cca-b4e5d88b9337 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:29.345739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-af9bb538-7b89-4b07-9cca-b4e5d88b9337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.370855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.371465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.371744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.372380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.372692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.374295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.384647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 993/1982] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:29.388758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.390483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.402379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2fdd0-2865-4280-ae7e-0525144c791f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.405772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 990/1983] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:29.407563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9eecc3-b3d9-4fe4-832f-f9244f5b0fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.408233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eecc3-b3d9-4fe4-832f-f9244f5b0fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.408518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eecc3-b3d9-4fe4-832f-f9244f5b0fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.408791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eecc3-b3d9-4fe4-832f-f9244f5b0fc1 admin admin] PATH_INFO: `/v3/projects/30ba67b459ea4a58aa4e177158ec78c7/users/4bed309603e045e6ac3c39d0a7cece3c/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.413840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5807d7-b314-4b6e-9613-91ba7cfd8847 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.414126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5807d7-b314-4b6e-9613-91ba7cfd8847 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.414400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5807d7-b314-4b6e-9613-91ba7cfd8847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.424166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9eecc3-b3d9-4fe4-832f-f9244f5b0fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ba67b459ea4a58aa4e177158ec78c7, user_id=4bed309603e045e6ac3c39d0a7cece3c, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.426814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9eecc3-b3d9-4fe4-832f-f9244f5b0fc1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.435906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4e5807d7-b314-4b6e-9613-91ba7cfd8847 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:29.437147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4e5807d7-b314-4b6e-9613-91ba7cfd8847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.441452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 994/1984] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:29 2022] PUT /identity/v3/projects/30ba67b459ea4a58aa4e177158ec78c7/users/4bed309603e045e6ac3c39d0a7cece3c/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:29.451324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.451704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.452007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.480131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] MFA Rules not processed for user `4bed309603e045e6ac3c39d0a7cece3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:29.481366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.497541 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 991/1985] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:29.502008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5807d7-b314-4b6e-9613-91ba7cfd8847 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.510852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5807d7-b314-4b6e-9613-91ba7cfd8847 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.515440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.516067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.516346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.516616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.517258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:29.517555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.519152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.530488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 992/1986] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:16:29.535395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.544843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9dbd39-8214-44ca-8c16-b5ba8cac7776 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.550308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.550899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.552330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.552768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.553906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.556465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.563315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 995/1987] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:29.572792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.574468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.593233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 993/1988] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:29.596001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.654280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:29.675229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ab724-087f-4c7c-bce5-080b1551d09c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.675444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:29.680953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.681648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.682002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.682346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.683044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.685218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.688303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377074-20a4-4ef6-b279-81090a0cca96 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.714626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 994/1989] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:29.715824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.738150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34036-788b-4737-b240-8e0e1dc9bd98 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.743417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.744129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.744407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.744704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.745357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.746856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f85f7-4a7c-423f-8ac2-e9f493d71c43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009c623055dc4defa2bd74a82c6a7e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.746973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.747473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f85f7-4a7c-423f-8ac2-e9f493d71c43 service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.747758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f85f7-4a7c-423f-8ac2-e9f493d71c43 service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.748067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f85f7-4a7c-423f-8ac2-e9f493d71c43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.760824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 995/1990] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:29.762071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.772321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669c24a-3b92-4f3e-a72e-ce2c1af0d7d5 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.777310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.777893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.778171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.778447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.779081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.780685 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.791261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 996/1991] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:29.795319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.805883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb68c5-773a-4917-a7ed-5daab9596f6c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:29.806924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f85f7-4a7c-423f-8ac2-e9f493d71c43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.808984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f85f7-4a7c-423f-8ac2-e9f493d71c43 service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.810577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:29.811222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.811508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.811788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] PATH_INFO: `/v3/projects/c23c4bee9eff4e15b7a465fccd25455e/users/f169303b6d0d4507947158a369a20832/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.820516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 996/1992] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:29.829024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23c4bee9eff4e15b7a465fccd25455e, user_id=f169303b6d0d4507947158a369a20832, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:29.835313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:29.849475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 997/1993] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:29 2022] PUT /identity/v3/projects/c23c4bee9eff4e15b7a465fccd25455e/users/f169303b6d0d4507947158a369a20832/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:29.860129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641ae0-5efb-4d83-8fae-de235c359a8d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.860422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641ae0-5efb-4d83-8fae-de235c359a8d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.860728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641ae0-5efb-4d83-8fae-de235c359a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.895043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-92641ae0-5efb-4d83-8fae-de235c359a8d None None] MFA Rules not processed for user `f169303b6d0d4507947158a369a20832`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:29.896322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-92641ae0-5efb-4d83-8fae-de235c359a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.973857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 997/1994] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:29.985568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:29.987396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:30.052264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d18206-8b3b-49b8-b48f-25cbbca782cd admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:30.056050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a948b2c-c215-43bf-acbe-832a2ad6c2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:30.056665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948b2c-c215-43bf-acbe-832a2ad6c2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:30.057029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948b2c-c215-43bf-acbe-832a2ad6c2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:30.057305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a948b2c-c215-43bf-acbe-832a2ad6c2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:30.068309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948b2c-c215-43bf-acbe-832a2ad6c2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:30.069747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a948b2c-c215-43bf-acbe-832a2ad6c2c3 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:30.080968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 998/1995] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:34.875243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641ae0-5efb-4d83-8fae-de235c359a8d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:34.947510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:34.992689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641ae0-5efb-4d83-8fae-de235c359a8d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:35.000563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:35.001605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:35.002307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:35.002822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] PATH_INFO: `/v3/users/f169303b6d0d4507947158a369a20832` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:35.005492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f169303b6d0d4507947158a369a20832)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:35.016303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:35.100428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f169303b6d0d4507947158a369a20832'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.110710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f169303b6d0d4507947158a369a20832'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.112597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f169303b6d0d4507947158a369a20832'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.144466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f169303b6d0d4507947158a369a20832'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.159551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f169303b6d0d4507947158a369a20832'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.166822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 998/1996] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:34 2022] DELETE /identity/v3/users/f169303b6d0d4507947158a369a20832 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:35.175385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e547-987e-4d08-b356-9e366947e261 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:35.175920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e547-987e-4d08-b356-9e366947e261 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:35.176000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e547-987e-4d08-b356-9e366947e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:35.199217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4206e547-987e-4d08-b356-9e366947e261 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:35.200489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4206e547-987e-4d08-b356-9e366947e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:35.277204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 999/1997] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:35.288270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:35.290035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:35.357500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd58df-99c4-470a-b5bd-134c9bd3850d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:35.362075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d720d81-3cac-4313-b413-0d7e87b1e9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:35.362693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d720d81-3cac-4313-b413-0d7e87b1e9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:35.362976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d720d81-3cac-4313-b413-0d7e87b1e9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:35.363258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d720d81-3cac-4313-b413-0d7e87b1e9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:35.373212 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d720d81-3cac-4313-b413-0d7e87b1e9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:35.375245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d720d81-3cac-4313-b413-0d7e87b1e9f2 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:35.385358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 999/1998] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:35.666544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e547-987e-4d08-b356-9e366947e261 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:35.668237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4206e547-987e-4d08-b356-9e366947e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:35.684593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e547-987e-4d08-b356-9e366947e261 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:35.692004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:35.693176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:35.693532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:35.693882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] PATH_INFO: `/v3/projects/c23c4bee9eff4e15b7a465fccd25455e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:35.695148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23c4bee9eff4e15b7a465fccd25455e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:35.697283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:35.745210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:35.767549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23c4bee9eff4e15b7a465fccd25455e', 'request_id': 'req-2fce29f4-1507-403a-a095-bb9267eeb87e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.776294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23c4bee9eff4e15b7a465fccd25455e', 'request_id': 'req-2fce29f4-1507-403a-a095-bb9267eeb87e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.785602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23c4bee9eff4e15b7a465fccd25455e', 'request_id': 'req-2fce29f4-1507-403a-a095-bb9267eeb87e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.799854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] The token cache is being invalidate because project c23c4bee9eff4e15b7a465fccd25455e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:35.800378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.801793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2fce29f4-1507-403a-a095-bb9267eeb87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:35.803270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1000/1999] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:35 2022] DELETE /identity/v3/projects/c23c4bee9eff4e15b7a465fccd25455e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:35.808075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4d0c2-4a47-4cd6-ae2a-557c6ab90d62 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:35.808357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4d0c2-4a47-4cd6-ae2a-557c6ab90d62 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:35.808639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4d0c2-4a47-4cd6-ae2a-557c6ab90d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:35.831766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c4d4d0c2-4a47-4cd6-ae2a-557c6ab90d62 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:35.833494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c4d4d0c2-4a47-4cd6-ae2a-557c6ab90d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:35.907986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1000/2000] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:35.915950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921671a-f9c3-469e-ba31-50db66a7b2a2 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:35.916240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921671a-f9c3-469e-ba31-50db66a7b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:35.916527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921671a-f9c3-469e-ba31-50db66a7b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:35.937170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-0921671a-f9c3-469e-ba31-50db66a7b2a2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:35.938563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0921671a-f9c3-469e-ba31-50db66a7b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:35.947033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1001/2001] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:35.951168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4d0c2-4a47-4cd6-ae2a-557c6ab90d62 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:35.957918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:35.962396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4d0c2-4a47-4cd6-ae2a-557c6ab90d62 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:35.970172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:35.971013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:35.971399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:35.971709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:35.972517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:35.972827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:35.974419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:35.988502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1001/2002] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:35.994067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921671a-f9c3-469e-ba31-50db66a7b2a2 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.004382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921671a-f9c3-469e-ba31-50db66a7b2a2 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.010472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.011093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.011390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.011749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.012425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.014363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.053679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1002/2003] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:35 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:36.054570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.069516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a630c0-e962-4204-aa1b-d49ed9ac5c94 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.139234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.140397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.140712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.140982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.141616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.143633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.168606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1002/2004] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:36.173322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.184793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91699d44-5e86-4e77-afb4-c7d4115b0d47 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.192053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.193013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.193304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.193564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.195630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.197455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.223952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1003/2005] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:36.224721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.236916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345caf69-1d3d-48a2-b513-bc0c206513dd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.241554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef21ce-d544-4eef-85db-75d56ff187ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.242158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef21ce-d544-4eef-85db-75d56ff187ab admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.242462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef21ce-d544-4eef-85db-75d56ff187ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.242737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef21ce-d544-4eef-85db-75d56ff187ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.243383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef21ce-d544-4eef-85db-75d56ff187ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.245011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef21ce-d544-4eef-85db-75d56ff187ab admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.256317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1003/2006] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:36.260362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.270647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891417c1-bb13-407f-bd8c-0b55ad455d3e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.275655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.276351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.276628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.276903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] PATH_INFO: `/v3/projects/84d836308b1b400694e77c5c03571602/users/ec7bad90aa69434a9df43b318d64cbc6/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.294097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d836308b1b400694e77c5c03571602, user_id=ec7bad90aa69434a9df43b318d64cbc6, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.297380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.310507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1004/2007] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:36 2022] PUT /identity/v3/projects/84d836308b1b400694e77c5c03571602/users/ec7bad90aa69434a9df43b318d64cbc6/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:36.320988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088b54e-2935-4795-9577-43f1ce9c91fe None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.321272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088b54e-2935-4795-9577-43f1ce9c91fe None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.321589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088b54e-2935-4795-9577-43f1ce9c91fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.351312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5088b54e-2935-4795-9577-43f1ce9c91fe None None] MFA Rules not processed for user `ec7bad90aa69434a9df43b318d64cbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:36.352491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5088b54e-2935-4795-9577-43f1ce9c91fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:36.429338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1004/2008] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:36.433742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.495079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287656c-8f60-477b-baa9-36b696bc439c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.500561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.501242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.501525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.501792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.502402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.504317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.530491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1005/2009] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:36.534771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088b54e-2935-4795-9577-43f1ce9c91fe None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.545525 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088b54e-2935-4795-9577-43f1ce9c91fe None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.604038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.604654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.604936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.605214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.605848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.607767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.616116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:36.630412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1005/2010] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:36.634677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.645283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6156db5-f310-495a-a3bd-e93ce2d72766 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.650271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.650880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.651162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.651468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.652161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.653764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.664239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1006/2011] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:36.668151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.678572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c8ba3-867c-4d0d-88c2-01b579a74bb4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.683193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaca95-107a-430d-9a4e-51bf750c69b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.683796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaca95-107a-430d-9a4e-51bf750c69b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.684112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaca95-107a-430d-9a4e-51bf750c69b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.684393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaca95-107a-430d-9a4e-51bf750c69b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.685039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaca95-107a-430d-9a4e-51bf750c69b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.686626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaca95-107a-430d-9a4e-51bf750c69b7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.696988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1006/2012] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:36.700974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.710881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5d9e-b54d-4e44-bd53-f51e553019b0 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.715374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.716076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.716354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.716626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] PATH_INFO: `/v3/projects/7d118b6dc87040378dde5b72ac64bb7c/users/4a0fcaba15a0476ca4d98860d548188b/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.730858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d118b6dc87040378dde5b72ac64bb7c, user_id=4a0fcaba15a0476ca4d98860d548188b, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.733532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.743177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:36.748931 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1007/2013] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:36 2022] PUT /identity/v3/projects/7d118b6dc87040378dde5b72ac64bb7c/users/4a0fcaba15a0476ca4d98860d548188b/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:36.760186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73683-6e40-4618-b61a-df75d72852ba None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.760479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73683-6e40-4618-b61a-df75d72852ba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.760756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f73683-6e40-4618-b61a-df75d72852ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.788497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e9f73683-6e40-4618-b61a-df75d72852ba None None] MFA Rules not processed for user `4a0fcaba15a0476ca4d98860d548188b`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:36.789696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e9f73683-6e40-4618-b61a-df75d72852ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:36.855559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1007/2014] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:36.860513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.927415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7726-c842-4aa5-97cc-12afa5880ebc admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:36.932182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:36.932797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:36.933074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:36.933355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:36.933983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:36.935948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:36.964987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1008/2015] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:36.969243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f73683-6e40-4618-b61a-df75d72852ba None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:36.980340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f73683-6e40-4618-b61a-df75d72852ba None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:37.037268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:37.037882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.038161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.038437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.039057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:37.040994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:37.061223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1008/2016] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:36 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:37.066162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:37.076364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184e643-21f0-4d92-8980-f5d9a166bd95 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:37.082042 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:37.082640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.082918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.083192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.083848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:37.085437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:37.096315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1009/2017] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:37.100955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:37.111072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea294b0-5f6c-45b7-9e67-d6849c6d1267 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:37.115554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:37.116239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.116516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.116793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] PATH_INFO: `/v3/projects/3b018995fe1f4a638ae82dcae8617c88/users/020d8e832c7a4e6cbd5590d6a7091c1d/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.132963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b018995fe1f4a638ae82dcae8617c88, user_id=020d8e832c7a4e6cbd5590d6a7091c1d, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:37.135668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:37.150079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1009/2018] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:37 2022] PUT /identity/v3/projects/3b018995fe1f4a638ae82dcae8617c88/users/020d8e832c7a4e6cbd5590d6a7091c1d/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:37.154261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:37.164626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b14ba-b047-4981-865c-1e7b88cc2781 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:37.220767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b6eec-99f8-465e-86d1-e739f07c2bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:37.221390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b6eec-99f8-465e-86d1-e739f07c2bef admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.221671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b6eec-99f8-465e-86d1-e739f07c2bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.221944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b6eec-99f8-465e-86d1-e739f07c2bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.222592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b6eec-99f8-465e-86d1-e739f07c2bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:37.224238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b6eec-99f8-465e-86d1-e739f07c2bef admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:37.238593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1010/2019] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:37.240067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:37.251622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59999f0-c7af-43b7-96da-c59c4a5bef22 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:37.256392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:37.257124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.257421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.257694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] PATH_INFO: `/v3/projects/3b018995fe1f4a638ae82dcae8617c88/users/020d8e832c7a4e6cbd5590d6a7091c1d/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.259572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b018995fe1f4a638ae82dcae8617c88, user_id=020d8e832c7a4e6cbd5590d6a7091c1d, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:37.262240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:37.273616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1010/2020] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:37 2022] PUT /identity/v3/projects/3b018995fe1f4a638ae82dcae8617c88/users/020d8e832c7a4e6cbd5590d6a7091c1d/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:37.285470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.285835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.286182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.315298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] MFA Rules not processed for user `020d8e832c7a4e6cbd5590d6a7091c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:37.316564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:37.377576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:37.387989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1011/2021] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:37.399684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:37.401456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:37.424958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:37.463090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6605-4155-47d7-b90a-b564659332a0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:37.473947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:37.474570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:37.475111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:37.475388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:37.532009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:37.533468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:37.542276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1011/2022] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:40.168546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:40.169944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:40.182244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4269e1-043c-4ba6-af47-f446cdaff89d None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:40.185806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:40.186408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:40.186691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:40.187554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:40.252680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:40.254451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:40.264373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1012/2023] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:40.802510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:40.804011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:40.920351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5a82d-ddef-4b7c-bcd3-793be7d6fd27 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:40.948615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:40.953425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:40.953425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:40.953425 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] PATH_INFO: `/v3/users/fc8d421028674ab59ee16d3c98bc3bb7` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:40.956843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8d421028674ab59ee16d3c98bc3bb7)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:40.959431 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:41.021320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:41.032378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09addcf9-2a84-433e-b10e-592f03dd4c3f service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:41.040555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a1481-a7d1-463e-b362-793b940123d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:41.041480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a1481-a7d1-463e-b362-793b940123d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:41.042281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a1481-a7d1-463e-b362-793b940123d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:41.042667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a1481-a7d1-463e-b362-793b940123d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:41.065575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a1481-a7d1-463e-b362-793b940123d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:41.068154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8d421028674ab59ee16d3c98bc3bb7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.069163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a1481-a7d1-463e-b362-793b940123d9 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:41.079631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8d421028674ab59ee16d3c98bc3bb7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.082486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8d421028674ab59ee16d3c98bc3bb7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.089597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1013/2024] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:41.110842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8d421028674ab59ee16d3c98bc3bb7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.114262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:41.122076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8d421028674ab59ee16d3c98bc3bb7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.132171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1012/2025] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:40 2022] DELETE /identity/v3/users/fc8d421028674ab59ee16d3c98bc3bb7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:41.137405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:41.137405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:41.137405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:41.170464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:41.172723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:41.272430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1014/2026] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:41.276305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:41.278050 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:41.365587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc981b0-8436-40cb-9537-7a9f62cfdf95 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:41.369264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:41.369886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:41.370166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:41.370443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:41.380456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:41.382287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:41.394653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1013/2027] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:41.696407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:41.697907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:41.713698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e924-1fbb-497a-b5e9-b97e6dfe85f3 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:41.724257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:41.725801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:41.726102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:41.726390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] PATH_INFO: `/v3/projects/8194d79e782b49fda02c031ea5a8f308` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:41.727702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8194d79e782b49fda02c031ea5a8f308)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:41.729861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:41.789646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8194d79e782b49fda02c031ea5a8f308', 'request_id': 'req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.797517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8194d79e782b49fda02c031ea5a8f308', 'request_id': 'req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.805919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8194d79e782b49fda02c031ea5a8f308', 'request_id': 'req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.818570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] The token cache is being invalidate because project 8194d79e782b49fda02c031ea5a8f308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:41.818868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.819525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.821071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1015/2028] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:41 2022] DELETE /identity/v3/projects/8194d79e782b49fda02c031ea5a8f308 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:41.825663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:41.844993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abe808-a745-410c-9f0c-d560bc8382ba service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:41.904549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:41.905109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:41.905390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:41.906286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] PATH_INFO: `/v3/users/6ba19c3dfef443079a7fca70419f17f2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:41.907433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba19c3dfef443079a7fca70419f17f2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:41.909420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:41.955709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba19c3dfef443079a7fca70419f17f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.962627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba19c3dfef443079a7fca70419f17f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.963299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba19c3dfef443079a7fca70419f17f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.976765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba19c3dfef443079a7fca70419f17f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.986021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ed4aa2a-6834-411f-8a66-7b85ce58f512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba19c3dfef443079a7fca70419f17f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:41.992417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1014/2029] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:41 2022] DELETE /identity/v3/users/6ba19c3dfef443079a7fca70419f17f2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:42.293734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:42.295257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:42.310112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:42.329480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0bb1-71f9-45cb-97d0-ed703a75bc46 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:42.423790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:42.424553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.424840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.425112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] PATH_INFO: `/v3/projects/4f191bcc3e654c4e807252b566f3ecf6` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.426236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f191bcc3e654c4e807252b566f3ecf6)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:42.428174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:42.489106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f191bcc3e654c4e807252b566f3ecf6', 'request_id': 'req-0b988272-94df-4737-8f9a-7bcc56608d76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:42.495988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f191bcc3e654c4e807252b566f3ecf6', 'request_id': 'req-0b988272-94df-4737-8f9a-7bcc56608d76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:42.511209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f191bcc3e654c4e807252b566f3ecf6', 'request_id': 'req-0b988272-94df-4737-8f9a-7bcc56608d76'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:42.524595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] The token cache is being invalidate because project 4f191bcc3e654c4e807252b566f3ecf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:42.524889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:42.525573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0b988272-94df-4737-8f9a-7bcc56608d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:42.527356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1016/2030] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:42 2022] DELETE /identity/v3/projects/4f191bcc3e654c4e807252b566f3ecf6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:42.532167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3f6e-ff7e-4a08-a673-7f859b8d5072 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.532533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3f6e-ff7e-4a08-a673-7f859b8d5072 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.533134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a3f6e-ff7e-4a08-a673-7f859b8d5072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.557841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-037a3f6e-ff7e-4a08-a673-7f859b8d5072 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:42.559066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-037a3f6e-ff7e-4a08-a673-7f859b8d5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:42.572546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:42.690544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1015/2031] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:42.700665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251b4a-a520-40e3-9d5a-5555c2516c52 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.700853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251b4a-a520-40e3-9d5a-5555c2516c52 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.701205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251b4a-a520-40e3-9d5a-5555c2516c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.724312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-29251b4a-a520-40e3-9d5a-5555c2516c52 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:42.725834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-29251b4a-a520-40e3-9d5a-5555c2516c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:42.734520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1017/2032] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:42.739546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a3f6e-ff7e-4a08-a673-7f859b8d5072 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:42.750059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a3f6e-ff7e-4a08-a673-7f859b8d5072 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:42.754998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:42.755602 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.755921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.756202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.756845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:42.757151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:42.758741 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:42.770775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1016/2033] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:42.775261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29251b4a-a520-40e3-9d5a-5555c2516c52 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:42.786110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29251b4a-a520-40e3-9d5a-5555c2516c52 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:42.793903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:42.793903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.793903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.793903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.794290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:42.797177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:42.816628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:42.823414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:42.836925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1018/2034] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:42.837772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:42.838311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb81fd-c445-4360-a494-4e71a04cdb10 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:42.942675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:42.943412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.943765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.944161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] PATH_INFO: `/v3/users/8ed50744091a490a9b01f7cfe5f60f24` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.945587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed50744091a490a9b01f7cfe5f60f24)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:42.945940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ddd76-0876-4ebe-86ce-85807661d6d5 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:42.947901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:42.952546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:42.953183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:42.953473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:42.953739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:42.954546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:42.957585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:42.973019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:42.996549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1019/2035] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:42 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:43.001663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.005533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed50744091a490a9b01f7cfe5f60f24'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:43.012765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca0a13-f105-417d-a81d-241701f25ec3 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.014711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed50744091a490a9b01f7cfe5f60f24'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:43.016152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed50744091a490a9b01f7cfe5f60f24'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:43.018526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.019191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.019483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.019755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.020538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.022163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.030505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed50744091a490a9b01f7cfe5f60f24'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:43.036625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1020/2036] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:43.037668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.041253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a2e4e0f3-5630-4357-815a-fdbf7803f737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed50744091a490a9b01f7cfe5f60f24'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:43.048479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae74f-af6f-4bdc-8cf2-37668de7c9f0 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.048979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1017/2037] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:42 2022] DELETE /identity/v3/users/8ed50744091a490a9b01f7cfe5f60f24 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:43.053599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.053947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.054231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.079502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:43.081146 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.102096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:43.130414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.131941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.132390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.132822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.133639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.135432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.147104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1021/2038] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:43.151218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.152916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.153742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1018/2039] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:43.164340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.166350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.179280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e19c5d-6cca-45f8-8a04-f231dfe0d8a2 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.185765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201defaf-114e-4d3d-934f-2f1563fe4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.186532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201defaf-114e-4d3d-934f-2f1563fe4f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.187500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201defaf-114e-4d3d-934f-2f1563fe4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.187890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201defaf-114e-4d3d-934f-2f1563fe4f22 admin admin] PATH_INFO: `/v3/projects/399dc2e507d341a1aaaecfbed3e86065/users/4e4e1cb838594df0b87dfd87903012ca/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.206705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201defaf-114e-4d3d-934f-2f1563fe4f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399dc2e507d341a1aaaecfbed3e86065, user_id=4e4e1cb838594df0b87dfd87903012ca, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.209374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201defaf-114e-4d3d-934f-2f1563fe4f22 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.226838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1022/2040] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:43 2022] PUT /identity/v3/projects/399dc2e507d341a1aaaecfbed3e86065/users/4e4e1cb838594df0b87dfd87903012ca/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:43.237552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8269355-6811-4836-bfdc-2e3b6aaf63e6 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.237845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8269355-6811-4836-bfdc-2e3b6aaf63e6 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.238143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8269355-6811-4836-bfdc-2e3b6aaf63e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.240995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f08775-55ff-4d11-adb4-2d2e5005dd0f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.273247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f8269355-6811-4836-bfdc-2e3b6aaf63e6 None None] MFA Rules not processed for user `4e4e1cb838594df0b87dfd87903012ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:43.274804 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f8269355-6811-4836-bfdc-2e3b6aaf63e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.305483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.306104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.306386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.306663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.365331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1023/2041] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:43.366976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8269355-6811-4836-bfdc-2e3b6aaf63e6 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.413063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.415036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.428125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1019/2042] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:43.457837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:43.478029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8269355-6811-4836-bfdc-2e3b6aaf63e6 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.482777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.483464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.484370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.484852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.485545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.487457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.519446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1024/2043] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:43 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:43.520477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.537567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176aee0-855c-48be-bc2e-e7a39030d3c6 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.569032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:43.608177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.609503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.609997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.610305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.610936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.612883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.634481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1020/2044] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:43 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:16:43.638527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.649561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ad018-1fea-4bfa-ba8b-449cc27ef4ad admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.658375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f367b8-22a2-42d8-a727-c47d8d76e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.658666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f367b8-22a2-42d8-a727-c47d8d76e051 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.658954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f367b8-22a2-42d8-a727-c47d8d76e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.659226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f367b8-22a2-42d8-a727-c47d8d76e051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.659916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f367b8-22a2-42d8-a727-c47d8d76e051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.661539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f367b8-22a2-42d8-a727-c47d8d76e051 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.675308 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1025/2045] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:43.679935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.690952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86a3ca-9cdc-4033-ae0f-ad887a8463b4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.695713 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17c871-b269-43a8-9d19-ccb82cefb007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.696406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c871-b269-43a8-9d19-ccb82cefb007 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.696686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c871-b269-43a8-9d19-ccb82cefb007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.696959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17c871-b269-43a8-9d19-ccb82cefb007 admin admin] PATH_INFO: `/v3/projects/16da7db5a9094386b999608335e735ab/users/f18279bebe9a49d693eaef02c8d6da96/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.701088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd5dbd-ac79-4ec3-b874-a98a24f5b9ac None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.701763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd5dbd-ac79-4ec3-b874-a98a24f5b9ac None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.702343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd5dbd-ac79-4ec3-b874-a98a24f5b9ac None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.704726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1026/2046] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:16:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:16:43.716497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c871-b269-43a8-9d19-ccb82cefb007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16da7db5a9094386b999608335e735ab, user_id=f18279bebe9a49d693eaef02c8d6da96, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.720580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17c871-b269-43a8-9d19-ccb82cefb007 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.738064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1021/2047] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:43 2022] PUT /identity/v3/projects/16da7db5a9094386b999608335e735ab/users/f18279bebe9a49d693eaef02c8d6da96/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:43.743923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd5dbd-ac79-4ec3-b874-a98a24f5b9ac None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.746428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a791c-872f-4f82-8d01-b7b02dde2611 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.746797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a791c-872f-4f82-8d01-b7b02dde2611 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.747162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a791c-872f-4f82-8d01-b7b02dde2611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.772059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e00a791c-872f-4f82-8d01-b7b02dde2611 None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:43.774041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e00a791c-872f-4f82-8d01-b7b02dde2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.882254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd5dbd-ac79-4ec3-b874-a98a24f5b9ac None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.895558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.896339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.896709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.897401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:43.898191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:43.903314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1022/2048] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:43.904660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:43.947902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1027/2049] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:43.948528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a791c-872f-4f82-8d01-b7b02dde2611 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.957898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:43.970331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a791c-872f-4f82-8d01-b7b02dde2611 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:43.971632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:43.982181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a37a3-db7a-41c9-8863-0143e2b477d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:43.982902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a37a3-db7a-41c9-8863-0143e2b477d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:43.983191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a37a3-db7a-41c9-8863-0143e2b477d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:43.984020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a37a3-db7a-41c9-8863-0143e2b477d5 admin admin] PATH_INFO: `/v3/projects/16da7db5a9094386b999608335e735ab/users/f18279bebe9a49d693eaef02c8d6da96/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.006136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a37a3-db7a-41c9-8863-0143e2b477d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16da7db5a9094386b999608335e735ab, user_id=f18279bebe9a49d693eaef02c8d6da96, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.006136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a37a3-db7a-41c9-8863-0143e2b477d5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.010528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e972a-5c10-459a-940c-b8770cea708a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:44.024001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:44.024633 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.024912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.025185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.032068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1023/2050] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:43 2022] PUT /identity/v3/projects/16da7db5a9094386b999608335e735ab/users/f18279bebe9a49d693eaef02c8d6da96/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:44.038395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.040822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.047446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.047841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.048206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.054219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1028/2051] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:44.102180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] MFA Rules not processed for user `f18279bebe9a49d693eaef02c8d6da96`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:44.103488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:44.147751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:44.147751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:44.173840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f574c-b8e0-492f-933f-a4febf372d6a service placement] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:44.203202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1024/2052] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:44.214152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:44.215896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:44.222321 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:44.267576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:44.268620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.269358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.269785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] PATH_INFO: `/v3/projects/cdee27d214584dc49ec22e05d6b9af52` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.270962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdee27d214584dc49ec22e05d6b9af52)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.273871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.309415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea4888-ed1b-434f-a147-a8e85fdf09de None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:44.315402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:44.316346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.317416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.317873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.335667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.337670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.344090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:44.347325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdee27d214584dc49ec22e05d6b9af52', 'request_id': 'req-ae7f28ba-2e72-4529-a1ca-879499dda533'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.353848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1025/2053] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:44.357214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdee27d214584dc49ec22e05d6b9af52', 'request_id': 'req-ae7f28ba-2e72-4529-a1ca-879499dda533'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.368253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdee27d214584dc49ec22e05d6b9af52', 'request_id': 'req-ae7f28ba-2e72-4529-a1ca-879499dda533'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.386005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:44.386608 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] The token cache is being invalidate because project cdee27d214584dc49ec22e05d6b9af52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:44.386910 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.387661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.389270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1029/2054] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:44 2022] DELETE /identity/v3/projects/cdee27d214584dc49ec22e05d6b9af52 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:44.393818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:44.395201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:44.397257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ba57f-3882-4aa8-9684-b1e8d55bea5a service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:44.470038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:44.470949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.471545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.472012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] PATH_INFO: `/v3/users/4e4e1cb838594df0b87dfd87903012ca` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.474299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4e1cb838594df0b87dfd87903012ca)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.475197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f28ba-2e72-4529-a1ca-879499dda533 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:44.477423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.482356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:44.483143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.483489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.483897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] PATH_INFO: `/v3/users/4eaa14ac2668498bbae8bd014b2d2c0e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.485310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaa14ac2668498bbae8bd014b2d2c0e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.488050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.536418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4e1cb838594df0b87dfd87903012ca'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.545316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaa14ac2668498bbae8bd014b2d2c0e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.547189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaa14ac2668498bbae8bd014b2d2c0e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.548345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaa14ac2668498bbae8bd014b2d2c0e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.556004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4e1cb838594df0b87dfd87903012ca'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.556868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4e1cb838594df0b87dfd87903012ca'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.574004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaa14ac2668498bbae8bd014b2d2c0e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.578221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4e1cb838594df0b87dfd87903012ca'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.585260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f680a9dd-46e9-4edb-b9dc-d8318fc63c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaa14ac2668498bbae8bd014b2d2c0e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.592774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4e1cb838594df0b87dfd87903012ca'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.601394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1026/2055] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:44 2022] DELETE /identity/v3/users/4e4e1cb838594df0b87dfd87903012ca => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:44.602037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:44.603742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:44.606388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1030/2056] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:44 2022] DELETE /identity/v3/users/4eaa14ac2668498bbae8bd014b2d2c0e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:44.607538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.607928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.608227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.637590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:44.639016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:44.641598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:44.714667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:44.717848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c28a26-d288-4f60-bf84-73e55e510152 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:44.741131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1031/2057] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:44.759148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:44.760994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:44.803739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:44.804676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.805133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.805576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] PATH_INFO: `/v3/users/b5c693872cbf459aaeaeefacd33a717c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.807144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c693872cbf459aaeaeefacd33a717c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.809357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.838531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbd3c-b487-478f-9312-dcc9bbb6474a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:44.844044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:44.844581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:44.845359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:44.845658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:44.857871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:44.860613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:44.874026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1032/2058] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:44.881705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c693872cbf459aaeaeefacd33a717c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.889258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c693872cbf459aaeaeefacd33a717c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.890177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c693872cbf459aaeaeefacd33a717c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.912517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c693872cbf459aaeaeefacd33a717c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.932294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c693872cbf459aaeaeefacd33a717c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:44.942223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1027/2059] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:44 2022] DELETE /identity/v3/users/b5c693872cbf459aaeaeefacd33a717c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:45.010137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.012236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.045556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d162b-6ab6-416f-8e9e-d1450686392a service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.131350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.132024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.132313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.132589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] PATH_INFO: `/v3/projects/fd92f55415c447cc9d1565ad7faedded` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.133787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd92f55415c447cc9d1565ad7faedded)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.135906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.191339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd92f55415c447cc9d1565ad7faedded', 'request_id': 'req-0cc4e013-82aa-4f36-8991-74f3169a3007'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.201554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd92f55415c447cc9d1565ad7faedded', 'request_id': 'req-0cc4e013-82aa-4f36-8991-74f3169a3007'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.212011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd92f55415c447cc9d1565ad7faedded', 'request_id': 'req-0cc4e013-82aa-4f36-8991-74f3169a3007'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.228604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] The token cache is being invalidate because project fd92f55415c447cc9d1565ad7faedded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:45.228903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.229595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0cc4e013-82aa-4f36-8991-74f3169a3007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.231495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1033/2060] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:45 2022] DELETE /identity/v3/projects/fd92f55415c447cc9d1565ad7faedded => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:45.239853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.240012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.240131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.240217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.240217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.251766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1c6fd-7587-4227-abd4-ec72ed655ccb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.269593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:45.271322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.297951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:45.328427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:45.342955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.343845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.344143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.344482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] PATH_INFO: `/v3/projects/d51168103dd84666992f3fcc7d516d32` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.345553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51168103dd84666992f3fcc7d516d32)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.346938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1034/2061] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:45.347704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.349067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.355233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.364383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edc458-382c-4418-a97f-34cd8be46caa None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.368593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.369347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.369636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.369904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] PATH_INFO: `/v3/projects/399dc2e507d341a1aaaecfbed3e86065` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.371133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] RBAC: Authorizing `identity:delete_project(project_id=399dc2e507d341a1aaaecfbed3e86065)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.374886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.423181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51168103dd84666992f3fcc7d516d32', 'request_id': 'req-3413a464-f492-43f9-a4f7-e76dd1a36fe3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.428969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399dc2e507d341a1aaaecfbed3e86065', 'request_id': 'req-0bbeea0a-ec37-4355-853c-83852377706c'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.429107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51168103dd84666992f3fcc7d516d32', 'request_id': 'req-3413a464-f492-43f9-a4f7-e76dd1a36fe3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.435750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399dc2e507d341a1aaaecfbed3e86065', 'request_id': 'req-0bbeea0a-ec37-4355-853c-83852377706c'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.437697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51168103dd84666992f3fcc7d516d32', 'request_id': 'req-3413a464-f492-43f9-a4f7-e76dd1a36fe3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.444416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399dc2e507d341a1aaaecfbed3e86065', 'request_id': 'req-0bbeea0a-ec37-4355-853c-83852377706c'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.456945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] The token cache is being invalidate because project 399dc2e507d341a1aaaecfbed3e86065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:45.457229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.457915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0bbeea0a-ec37-4355-853c-83852377706c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.459337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] The token cache is being invalidate because project d51168103dd84666992f3fcc7d516d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:45.459616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1035/2062] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:45 2022] DELETE /identity/v3/projects/399dc2e507d341a1aaaecfbed3e86065 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:45.459720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.460717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.460998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.461267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.463009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.464687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1028/2063] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:45 2022] DELETE /identity/v3/projects/d51168103dd84666992f3fcc7d516d32 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:45.465508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.468902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.482202 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:45.483375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.544542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a464-f492-43f9-a4f7-e76dd1a36fe3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.553657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1036/2064] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:45.554598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.555981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.569197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e5310-cb82-4a48-8e25-7b0784cad252 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.573996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.574620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.574901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.575174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] PATH_INFO: `/v3/users/f18279bebe9a49d693eaef02c8d6da96` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.576318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18279bebe9a49d693eaef02c8d6da96)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.578412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.611842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.612509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.612785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.613058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] PATH_INFO: `/v3/users/ec7bad90aa69434a9df43b318d64cbc6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.614226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec7bad90aa69434a9df43b318d64cbc6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.616180 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.631485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:45.633297 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18279bebe9a49d693eaef02c8d6da96'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.634206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18279bebe9a49d693eaef02c8d6da96'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.635145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18279bebe9a49d693eaef02c8d6da96'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.649538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18279bebe9a49d693eaef02c8d6da96'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.651829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:45.658046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18279bebe9a49d693eaef02c8d6da96'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.671603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec7bad90aa69434a9df43b318d64cbc6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.675319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1037/2065] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:45 2022] DELETE /identity/v3/users/f18279bebe9a49d693eaef02c8d6da96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:45.678497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.678497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.682486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec7bad90aa69434a9df43b318d64cbc6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.683271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec7bad90aa69434a9df43b318d64cbc6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.698805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec7bad90aa69434a9df43b318d64cbc6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.708730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec7bad90aa69434a9df43b318d64cbc6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.715878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1029/2066] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:45 2022] DELETE /identity/v3/users/ec7bad90aa69434a9df43b318d64cbc6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:45.717174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.723832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.765047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699543c-8c2a-4a01-8790-8ef19cf04e84 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.808845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18faa94-5f19-4b43-bf7f-f87b0d22f493 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.814111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911b84-bb9c-459d-b0a7-da44ce5cf860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.814784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911b84-bb9c-459d-b0a7-da44ce5cf860 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.815123 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911b84-bb9c-459d-b0a7-da44ce5cf860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.815541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911b84-bb9c-459d-b0a7-da44ce5cf860 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.816162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911b84-bb9c-459d-b0a7-da44ce5cf860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:45.816463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911b84-bb9c-459d-b0a7-da44ce5cf860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.818738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911b84-bb9c-459d-b0a7-da44ce5cf860 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.835654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1030/2067] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:45.835654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0dc5-2999-422f-89d7-249693cb2f37 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.835654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0dc5-2999-422f-89d7-249693cb2f37 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.835654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf0dc5-2999-422f-89d7-249693cb2f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.868018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.869139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.869139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.869359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] PATH_INFO: `/v3/users/3fd2211d423a4baa9981955b248e9727` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.870359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd2211d423a4baa9981955b248e9727)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.872486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.879713 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-63bf0dc5-2999-422f-89d7-249693cb2f37 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:45.884029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-63bf0dc5-2999-422f-89d7-249693cb2f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.894930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1031/2068] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:45.896185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0dc5-2999-422f-89d7-249693cb2f37 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.919077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf0dc5-2999-422f-89d7-249693cb2f37 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:45.925018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:45.925642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:45.925913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:45.926227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:45.926822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:45.928787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:45.937856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd2211d423a4baa9981955b248e9727'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.939376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd2211d423a4baa9981955b248e9727'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.940168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd2211d423a4baa9981955b248e9727'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.954816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd2211d423a4baa9981955b248e9727'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.963393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd2211d423a4baa9981955b248e9727'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:45.964353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1032/2069] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:45 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:45.965404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.966781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:45.967520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:45.990555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1038/2070] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:45 2022] DELETE /identity/v3/users/3fd2211d423a4baa9981955b248e9727 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:45.991399 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:45.992881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.058071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f58938-189c-4d7f-8c12-5f7695faf9ab admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.132120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:46.149643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cffa2-7556-4861-b147-8bb003eafd29 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.156503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.157228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.157613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.157950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.158664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.160838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.182264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.183459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.184112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.185217 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.187709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.194171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1039/2071] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:45 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:46.195648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.197891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.203167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.204629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.212052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1131-cd2e-4f9d-b4d0-062cbb9e3e9b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.215673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1033/2072] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:46.216595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.217221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.218756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.219109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.219456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] PATH_INFO: `/v3/projects/16da7db5a9094386b999608335e735ab` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.220968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16da7db5a9094386b999608335e735ab)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.222759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.227785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0deb28-744b-4af6-8a0b-8678e6153508 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.233635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.234456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.234728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.235021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.235903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.238132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.249869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1034/2073] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:46.254013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.267086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a3e20-e7f1-400d-81f9-c1a7be2a59a7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.272995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.273606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.273893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.274170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.275020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.276864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.291639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16da7db5a9094386b999608335e735ab', 'request_id': 'req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.300776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1035/2074] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:46.301266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16da7db5a9094386b999608335e735ab', 'request_id': 'req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.305783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.320810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16da7db5a9094386b999608335e735ab', 'request_id': 'req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.324923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944a6e7-e4b3-46da-af18-df80843091e5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.351106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] The token cache is being invalidate because project 16da7db5a9094386b999608335e735ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:46.352203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.352725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-40834ff0-cdb0-43d7-9d4b-e1cf959bf5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.354797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1040/2075] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:46 2022] DELETE /identity/v3/projects/16da7db5a9094386b999608335e735ab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:46.362088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7f0d-a097-4c44-b066-84d75f2d6a98 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.362327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7f0d-a097-4c44-b066-84d75f2d6a98 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.362936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7f0d-a097-4c44-b066-84d75f2d6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.392582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-404e7f0d-a097-4c44-b066-84d75f2d6a98 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:46.395426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-404e7f0d-a097-4c44-b066-84d75f2d6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.464980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7412689-3202-4866-b57e-7c56518f2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.465747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7412689-3202-4866-b57e-7c56518f2f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.466031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7412689-3202-4866-b57e-7c56518f2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.466447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7412689-3202-4866-b57e-7c56518f2f20 admin admin] PATH_INFO: `/v3/projects/cc7e667f3b04440b95d7e2deb23e4b2c/users/237f39d6f921423e92e98c135808f4b1/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.483943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7412689-3202-4866-b57e-7c56518f2f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7e667f3b04440b95d7e2deb23e4b2c, user_id=237f39d6f921423e92e98c135808f4b1, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.486813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7412689-3202-4866-b57e-7c56518f2f20 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.489898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1041/2076] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:46.497458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.497736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.498012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.501650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1036/2077] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:46 2022] PUT /identity/v3/projects/cc7e667f3b04440b95d7e2deb23e4b2c/users/237f39d6f921423e92e98c135808f4b1/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:46.512372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.512819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.512977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:46.513106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.532154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:46.533672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.549417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] MFA Rules not processed for user `237f39d6f921423e92e98c135808f4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:46.551091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.673226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1042/2078] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:46.676537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.676537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.679415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1037/2079] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:46.680356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.681583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.696008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776aff6-73e6-493a-a69d-7876511fcb5b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.701167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.701876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.702295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.703228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] PATH_INFO: `/v3/projects/1b0cdbdb2fca46e6a8f007dbe9dd9ec8` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.704471 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0cdbdb2fca46e6a8f007dbe9dd9ec8)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.705748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53565c-788b-466f-a75c-6ba29c65b7e4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.706431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.710808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.711438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.711716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.712028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] PATH_INFO: `/v3/projects/84d836308b1b400694e77c5c03571602` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.713151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d836308b1b400694e77c5c03571602)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.715024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.732765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:46.763645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0cdbdb2fca46e6a8f007dbe9dd9ec8', 'request_id': 'req-a7a69b07-e1e1-43b7-a776-8235a51b0020'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.766927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d836308b1b400694e77c5c03571602', 'request_id': 'req-041f227f-750c-4fba-a06c-65ce811b59d9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.770378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0cdbdb2fca46e6a8f007dbe9dd9ec8', 'request_id': 'req-a7a69b07-e1e1-43b7-a776-8235a51b0020'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.772914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d836308b1b400694e77c5c03571602', 'request_id': 'req-041f227f-750c-4fba-a06c-65ce811b59d9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.778244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0cdbdb2fca46e6a8f007dbe9dd9ec8', 'request_id': 'req-a7a69b07-e1e1-43b7-a776-8235a51b0020'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.780729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d836308b1b400694e77c5c03571602', 'request_id': 'req-041f227f-750c-4fba-a06c-65ce811b59d9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.789733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] The token cache is being invalidate because project 1b0cdbdb2fca46e6a8f007dbe9dd9ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:46.790098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.790817 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.792425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1043/2080] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:46 2022] DELETE /identity/v3/projects/1b0cdbdb2fca46e6a8f007dbe9dd9ec8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:46.793306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.793415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] The token cache is being invalidate because project 84d836308b1b400694e77c5c03571602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:46.793746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.794826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.796257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:46.798066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1038/2081] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:46 2022] DELETE /identity/v3/projects/84d836308b1b400694e77c5c03571602 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:46.798831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.800183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.872956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a69b07-e1e1-43b7-a776-8235a51b0020 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.876013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f227f-750c-4fba-a06c-65ce811b59d9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:46.878588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71570f-40ea-485c-9ab5-685488fd2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.879228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71570f-40ea-485c-9ab5-685488fd2b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.879511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71570f-40ea-485c-9ab5-685488fd2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.879834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71570f-40ea-485c-9ab5-685488fd2b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.880548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71570f-40ea-485c-9ab5-685488fd2b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:46.880796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71570f-40ea-485c-9ab5-685488fd2b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.881107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:46.881753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.882037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.882317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.882418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71570f-40ea-485c-9ab5-685488fd2b91 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.882951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:46.884946 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:46.899178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1044/2082] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:46.900588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:46.900885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:46.901394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:46.922117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:46.925935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1039/2083] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:46 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:46.926456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.927045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.929546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.941705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:46.998331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1045/2084] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:46.998331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:46.998331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:46.998663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01683030-a9d5-4c42-9fe4-41071e42fbfc admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.003735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.004401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.004673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.004942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] PATH_INFO: `/v3/users/4a0fcaba15a0476ca4d98860d548188b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.006121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0fcaba15a0476ca4d98860d548188b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.008025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca82bc-97c0-46ad-8dc0-9f8c75ef5643 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.008152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.012857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.013456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.013733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.014011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.014660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.016758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.044150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:47.049119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1046/2085] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:46 2022] POST /identity/v3/projects => generated 401 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:47.049948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.064363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0fcaba15a0476ca4d98860d548188b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.072021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0fcaba15a0476ca4d98860d548188b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.072746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0fcaba15a0476ca4d98860d548188b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.085448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0fcaba15a0476ca4d98860d548188b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.093279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f8c0ea7b-aac7-45b4-9e97-be01c9cc7da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0fcaba15a0476ca4d98860d548188b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.100154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1040/2086] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:46 2022] DELETE /identity/v3/users/4a0fcaba15a0476ca4d98860d548188b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:47.101356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.101638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.101916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.122027 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c1d3-ceed-4c14-ae3d-8f969272866e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.123871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:47.125903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.222832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.223458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.223731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.224025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.225087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.229432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.261433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1041/2087] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:47.261433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.261433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.266200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1047/2088] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:47 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:47.269967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.275901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18305322-1e85-44c4-93d9-df31c2b74737 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.281247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c2b84-cf3a-4328-b8c1-749261bd98a8 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.281821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.282719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.283523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.283898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.284545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.287285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.289244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.290502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.290931 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.291349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.292247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:47.292702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.295095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.314105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1048/2089] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:47.315332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.319077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.333656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8cc11-996b-42fe-89ec-9badd1447750 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.335922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1042/2090] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:47 2022] POST /identity/v3/users => generated 301 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:47.337018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.341663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.342325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.342606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.343532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.344580 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.346238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.351635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a4ab4-ef04-44ea-9d34-57d0c6727bf8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.359940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1049/2091] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:47.360090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.360189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.360293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.360293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.360293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.360293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.362247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.374472 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb452e-4919-432b-9152-1915d92d1ad4 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.384194 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.385160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.385540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.385949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.386659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.388430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.396144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:47.398142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1043/2092] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:47 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:47.401880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.412357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1050/2093] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:47.413347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.425515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7ee3a-67fb-40be-8ca5-6c46dc34076e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.481516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aef80d-b6a0-4925-b100-85c429e20d41 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.487154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.487276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.487497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.487780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] PATH_INFO: `/v3/projects/51d3bb78dd0944cfbf479ab2fb1b6d12/users/40e3769ba0564ae3a62b5d8c425ad416/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.503453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.504099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.504447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.504695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.505061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d3bb78dd0944cfbf479ab2fb1b6d12, user_id=40e3769ba0564ae3a62b5d8c425ad416, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.505543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.507469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.507792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.510246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:47.525333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1044/2094] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:47 2022] PUT /identity/v3/projects/51d3bb78dd0944cfbf479ab2fb1b6d12/users/40e3769ba0564ae3a62b5d8c425ad416/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:47.529671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.536533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1051/2095] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:47 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:47.536533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.537278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.551618 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d8e0c-076a-457d-b579-6d73aa1939b2 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.620142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.620399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9491f-f1e1-4923-a278-215c4e2431da admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.620828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.621105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.621381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] PATH_INFO: `/v3/projects/7d118b6dc87040378dde5b72ac64bb7c` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.622510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d118b6dc87040378dde5b72ac64bb7c)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.625102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.625789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.626416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.626690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.626958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.627595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.629247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.643198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1045/2096] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:47.644092 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.655789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e5dc0-094b-4b18-bf46-be6393eb9ec7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.665399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.666271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.666717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.667076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.667823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.669512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.681218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1046/2097] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:47.681982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d118b6dc87040378dde5b72ac64bb7c', 'request_id': 'req-c4440220-7248-44a4-a9f8-c8ccdf417a6e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.682172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.689071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d118b6dc87040378dde5b72ac64bb7c', 'request_id': 'req-c4440220-7248-44a4-a9f8-c8ccdf417a6e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.696871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34f6a1-0815-4deb-9710-05bc0da9cea0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.697137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d118b6dc87040378dde5b72ac64bb7c', 'request_id': 'req-c4440220-7248-44a4-a9f8-c8ccdf417a6e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.710875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] The token cache is being invalidate because project 7d118b6dc87040378dde5b72ac64bb7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:47.711165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.711856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:47.717300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1052/2098] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:47 2022] DELETE /identity/v3/projects/7d118b6dc87040378dde5b72ac64bb7c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:47.717300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.717300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.742780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:47.767964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.768581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.768861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.769149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.769830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.771448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.781546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1047/2099] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:47.782327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.784363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.791206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440220-7248-44a4-a9f8-c8ccdf417a6e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.796972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9a56c-675d-49de-83c2-ad62d578a057 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.797232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.797906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.798192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.798496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] PATH_INFO: `/v3/projects/5576d416db0b4ae190ecdcb20e8b8906/users/d19bedf7986d49c2aa5d0c7d3b38973d/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.802216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.803432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.803734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.804045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] PATH_INFO: `/v3/projects/51d3bb78dd0944cfbf479ab2fb1b6d12/users/40e3769ba0564ae3a62b5d8c425ad416/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.809450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d3bb78dd0944cfbf479ab2fb1b6d12, user_id=40e3769ba0564ae3a62b5d8c425ad416, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.810982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.814810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5576d416db0b4ae190ecdcb20e8b8906, user_id=d19bedf7986d49c2aa5d0c7d3b38973d, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.817571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.823466 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1048/2100] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:47 2022] PUT /identity/v3/projects/51d3bb78dd0944cfbf479ab2fb1b6d12/users/40e3769ba0564ae3a62b5d8c425ad416/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:47.824632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.831432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.841549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1053/2101] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:47 2022] PUT /identity/v3/projects/5576d416db0b4ae190ecdcb20e8b8906/users/d19bedf7986d49c2aa5d0c7d3b38973d/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:47.842649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:47.845099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:47.907859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0307-12a9-409c-bfe3-793838801e8c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.912401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:47.921494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02babb1-fdfe-473d-8ab3-989a931d8bae admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:47.926230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873171-ec1c-4ed3-a359-ba9c40085777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.926843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873171-ec1c-4ed3-a359-ba9c40085777 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.927128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873171-ec1c-4ed3-a359-ba9c40085777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.927401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873171-ec1c-4ed3-a359-ba9c40085777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.928077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873171-ec1c-4ed3-a359-ba9c40085777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.929692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873171-ec1c-4ed3-a359-ba9c40085777 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.939623 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1054/2102] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:47.940843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf55925-6fbc-4400-a5ee-e01ba95bcc76 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.941127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf55925-6fbc-4400-a5ee-e01ba95bcc76 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.941402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf55925-6fbc-4400-a5ee-e01ba95bcc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.974159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:47.975099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:47.975341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:47.975616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] PATH_INFO: `/v3/users/020d8e832c7a4e6cbd5590d6a7091c1d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:47.976796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020d8e832c7a4e6cbd5590d6a7091c1d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:47.978714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:47.987901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2cf55925-6fbc-4400-a5ee-e01ba95bcc76 None None] MFA Rules not processed for user `40e3769ba0564ae3a62b5d8c425ad416`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:47.989226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2cf55925-6fbc-4400-a5ee-e01ba95bcc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.041666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020d8e832c7a4e6cbd5590d6a7091c1d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.049612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020d8e832c7a4e6cbd5590d6a7091c1d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.050512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020d8e832c7a4e6cbd5590d6a7091c1d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.064539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020d8e832c7a4e6cbd5590d6a7091c1d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.072255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1055/2103] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:48.073573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.073926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.074273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.079282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020d8e832c7a4e6cbd5590d6a7091c1d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.089747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1049/2104] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:47 2022] DELETE /identity/v3/users/020d8e832c7a4e6cbd5590d6a7091c1d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:48.096113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.097975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.108899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] MFA Rules not processed for user `d19bedf7986d49c2aa5d0c7d3b38973d`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:48.110700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.125594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:48.191941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1056/2105] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:48.191941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.192208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.219508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b413d-78dd-4f52-8319-aa6fbd7c9d33 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:48.225560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:48.226514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.226636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.226990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] PATH_INFO: `/v3/projects/5eaeb9a6b807413898db918b4b2a5551/users/0f4e94d3e5e149308a222bf13263071b/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.258323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaeb9a6b807413898db918b4b2a5551, user_id=0f4e94d3e5e149308a222bf13263071b, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:48.263675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:48.317083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1050/2106] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:48 2022] PUT /identity/v3/projects/5eaeb9a6b807413898db918b4b2a5551/users/0f4e94d3e5e149308a222bf13263071b/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:48.317814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.319500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.335459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d0c7f-bce8-4449-bca1-1e2a93f85d23 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:48.343760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:48.402135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caa205-ba76-4548-9f0a-dbe1742d08d3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:48.407140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe2109-1e3e-4bf8-a630-c9244b1f793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:48.407956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe2109-1e3e-4bf8-a630-c9244b1f793c admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.408310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe2109-1e3e-4bf8-a630-c9244b1f793c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.408685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe2109-1e3e-4bf8-a630-c9244b1f793c admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.409360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe2109-1e3e-4bf8-a630-c9244b1f793c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:48.411349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe2109-1e3e-4bf8-a630-c9244b1f793c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:48.416214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:48.418195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.418706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.419276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.423460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.454071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1051/2107] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:48 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:48.455435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f3920-d47d-449e-99d7-f8d3e9ade042 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.455792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f3920-d47d-449e-99d7-f8d3e9ade042 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.456203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f3920-d47d-449e-99d7-f8d3e9ade042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.510129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e83f3920-d47d-449e-99d7-f8d3e9ade042 None None] MFA Rules not processed for user `0f4e94d3e5e149308a222bf13263071b`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:48.511331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e83f3920-d47d-449e-99d7-f8d3e9ade042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.529105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:48.532985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:48.546818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1057/2108] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:48.558085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.559509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.573640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098a50b-ff33-43fc-834e-bfce4faaaa43 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:48.597331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1052/2109] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:48.598169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f3920-d47d-449e-99d7-f8d3e9ade042 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.610940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:48.661311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:48.661875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.662154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.662418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] PATH_INFO: `/v3/projects/3b018995fe1f4a638ae82dcae8617c88` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.663575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b018995fe1f4a638ae82dcae8617c88)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:48.665549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:48.685400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f3920-d47d-449e-99d7-f8d3e9ade042 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:48.691318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:48.692036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.692310 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.692585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.693514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:48.695875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:48.718869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1053/2110] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:48 2022] POST /identity/v3/users => generated 306 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:48.719576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.721197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.723139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b018995fe1f4a638ae82dcae8617c88', 'request_id': 'req-af96f12b-999c-443e-9b14-68597d3c8720'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.729683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b018995fe1f4a638ae82dcae8617c88', 'request_id': 'req-af96f12b-999c-443e-9b14-68597d3c8720'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.738838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b018995fe1f4a638ae82dcae8617c88', 'request_id': 'req-af96f12b-999c-443e-9b14-68597d3c8720'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.742155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:48.751619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] The token cache is being invalidate because project 3b018995fe1f4a638ae82dcae8617c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:48.751936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.752591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:48.754083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1058/2111] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:48 2022] DELETE /identity/v3/projects/3b018995fe1f4a638ae82dcae8617c88 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:48.758377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.758377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.785059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e57e74-6c00-49b2-9e3f-911bcb6579e5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:48.820658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96f12b-999c-443e-9b14-68597d3c8720 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:48.824330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:48.824941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.825222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.825496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.828093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.843739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db789b7-1fc1-4409-8f06-435bf18acfca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:48.844435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db789b7-1fc1-4409-8f06-435bf18acfca service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.844721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db789b7-1fc1-4409-8f06-435bf18acfca service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.845022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db789b7-1fc1-4409-8f06-435bf18acfca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.846806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5db789b7-1fc1-4409-8f06-435bf18acfca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.890486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:48.891960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:48.901410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1059/2112] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:48.902233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:48.903664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.909971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:48.912611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db789b7-1fc1-4409-8f06-435bf18acfca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:48.914831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db789b7-1fc1-4409-8f06-435bf18acfca service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:48.928188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1054/2113] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:48.929434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8fab-00be-46e8-a0cf-2bc38d8b6089 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:48.929727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8fab-00be-46e8-a0cf-2bc38d8b6089 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:48.930035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8fab-00be-46e8-a0cf-2bc38d8b6089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:48.966171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-686b8fab-00be-46e8-a0cf-2bc38d8b6089 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:48.968265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-686b8fab-00be-46e8-a0cf-2bc38d8b6089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:48.995850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6cc7c-50a9-4eb5-915d-fe11aeb99e2a service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.003344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.004162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.004419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.004750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.005473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.007199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.034591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1060/2114] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:49.034591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.035375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.052318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c00290-216a-4113-8619-f85e652acb4a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.058457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1055/2115] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:49.060505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b8fab-00be-46e8-a0cf-2bc38d8b6089 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.066410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.067393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.067703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.068127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] PATH_INFO: `/v3/users/0f4e94d3e5e149308a222bf13263071b` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.069868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4e94d3e5e149308a222bf13263071b)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.071848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.080535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b8fab-00be-46e8-a0cf-2bc38d8b6089 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.087740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0f255-ca4e-4d09-b424-6c9e34396390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.088681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0f255-ca4e-4d09-b424-6c9e34396390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.089113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0f255-ca4e-4d09-b424-6c9e34396390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.089540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0f255-ca4e-4d09-b424-6c9e34396390 admin admin] PATH_INFO: `/v3/projects/a0561d4d40594528af674b4304d7132c/users/a5f3f7b7930447f1adef4bf40167ca99/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.116451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0f255-ca4e-4d09-b424-6c9e34396390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0561d4d40594528af674b4304d7132c, user_id=a5f3f7b7930447f1adef4bf40167ca99, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.119451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0f255-ca4e-4d09-b424-6c9e34396390 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.142568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1056/2116] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:49 2022] PUT /identity/v3/projects/a0561d4d40594528af674b4304d7132c/users/a5f3f7b7930447f1adef4bf40167ca99/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:49.144170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af2e71-dad7-40da-b9ee-a2ba34120025 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.144675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af2e71-dad7-40da-b9ee-a2ba34120025 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.145026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af2e71-dad7-40da-b9ee-a2ba34120025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.152778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.162393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4e94d3e5e149308a222bf13263071b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:49.163343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4e94d3e5e149308a222bf13263071b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:49.164246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4e94d3e5e149308a222bf13263071b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:49.169824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b0af2e71-dad7-40da-b9ee-a2ba34120025 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:49.171143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b0af2e71-dad7-40da-b9ee-a2ba34120025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.180380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4e94d3e5e149308a222bf13263071b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:49.191681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4e94d3e5e149308a222bf13263071b'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:49.208265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1061/2117] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:49 2022] DELETE /identity/v3/users/0f4e94d3e5e149308a222bf13263071b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:49.209182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.210609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.245045 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1057/2118] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:49.246417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedca9b-56e8-431a-8bec-7a8a938cb892 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.246779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedca9b-56e8-431a-8bec-7a8a938cb892 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.247943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedca9b-56e8-431a-8bec-7a8a938cb892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.269568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-dbedca9b-56e8-431a-8bec-7a8a938cb892 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:49.270937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dbedca9b-56e8-431a-8bec-7a8a938cb892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.298940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeed3c7-54e3-48c8-951c-335e8351a569 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.304909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.305528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.305848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.306145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.306767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.308514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.327706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1062/2119] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:49.328644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.346656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eadd1-05d5-48ee-a272-0fcd4c889ce1 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.351885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.352511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.352801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.353080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.353931 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:49.355583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1058/2120] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:49.355924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.357033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedca9b-56e8-431a-8bec-7a8a938cb892 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.357830 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.368688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.370347 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedca9b-56e8-431a-8bec-7a8a938cb892 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.378027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.380475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.381221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.381771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] PATH_INFO: `/v3/projects/a0561d4d40594528af674b4304d7132c/users/a5f3f7b7930447f1adef4bf40167ca99/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.384214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1063/2121] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:49.384418 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0561d4d40594528af674b4304d7132c, user_id=a5f3f7b7930447f1adef4bf40167ca99, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.385992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.388209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.390615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.403852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1059/2122] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:49 2022] PUT /identity/v3/projects/a0561d4d40594528af674b4304d7132c/users/a5f3f7b7930447f1adef4bf40167ca99/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:49.403852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.476797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45e3ac-2eed-4929-9c5d-9d8ca4fd0a85 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.480002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522545cd-01ad-4308-8318-6c78e7b66a45 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.500002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d189938-7947-4903-b466-58bf619cd2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.500533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d189938-7947-4903-b466-58bf619cd2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.500819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d189938-7947-4903-b466-58bf619cd2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.501098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d189938-7947-4903-b466-58bf619cd2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.501734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d189938-7947-4903-b466-58bf619cd2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.503643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d189938-7947-4903-b466-58bf619cd2e4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.532134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.532777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.533058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.533329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.534631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1060/2123] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:49 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:49.535967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9578d4-5641-433a-815b-55e6e0d18280 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.536293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9578d4-5641-433a-815b-55e6e0d18280 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.536574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9578d4-5641-433a-815b-55e6e0d18280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.545192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.546695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.557064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1064/2124] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:49.557841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.566182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1b9578d4-5641-433a-815b-55e6e0d18280 None None] MFA Rules not processed for user `a5f3f7b7930447f1adef4bf40167ca99`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:49.567588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911ca6-861e-4a3d-bd57-d40dcc8152bf service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.567983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1b9578d4-5641-433a-815b-55e6e0d18280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.574999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.659185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.659832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.660146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.660425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.661079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.663225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.687852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1061/2125] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:49.691797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1065/2126] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:49 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:49.693335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9578d4-5641-433a-815b-55e6e0d18280 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.697742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.700541 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.706569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9578d4-5641-433a-815b-55e6e0d18280 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.712813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.714364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.714828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.715274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.716201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.718600 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.729829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1062/2127] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:49.734428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.748055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c091-7c42-44a7-a101-8fb985119693 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.756167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:49.760669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.760969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.761227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.761687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.762484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.764147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.775863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11a10-225c-4a56-93f0-7a8c053baccd admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.776514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1063/2128] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:49.780986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.789981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe237-3193-4c50-861b-2888f976520e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.790897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe237-3193-4c50-861b-2888f976520e service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.791229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe237-3193-4c50-861b-2888f976520e service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.791900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe237-3193-4c50-861b-2888f976520e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.803328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0197047-daf4-4a43-804c-35d108a26297 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.807463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe237-3193-4c50-861b-2888f976520e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.809728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe237-3193-4c50-861b-2888f976520e service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.814939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.815853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.816360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.816790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] PATH_INFO: `/v3/projects/c73a224fc7784fd6876e81a0e7097127/users/388379cb8722477fbba3162dcbe3cc8a/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.827896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1066/2129] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:49.840712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73a224fc7784fd6876e81a0e7097127, user_id=388379cb8722477fbba3162dcbe3cc8a, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.843564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:49.865328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1064/2130] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:49 2022] PUT /identity/v3/projects/c73a224fc7784fd6876e81a0e7097127/users/388379cb8722477fbba3162dcbe3cc8a/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:49.870439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.870743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.871017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.895548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:49.896989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.923768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.969328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1067/2131] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:49.971985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:49.973344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:49.988607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281fa02-d8fe-4d0c-99cc-2594bdf1ece2 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:49.993852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:49.994539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:49.994766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:49.995040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] PATH_INFO: `/v3/projects/5eaeb9a6b807413898db918b4b2a5551` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:49.996209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eaeb9a6b807413898db918b4b2a5551)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:49.998551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.014394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856849e-c128-44fa-ac7d-9b21197786d4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.018805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60b240-3d98-4c2d-ba5d-3f9ef446ce1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.019420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60b240-3d98-4c2d-ba5d-3f9ef446ce1b service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.019707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60b240-3d98-4c2d-ba5d-3f9ef446ce1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.020015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60b240-3d98-4c2d-ba5d-3f9ef446ce1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.021775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7e60b240-3d98-4c2d-ba5d-3f9ef446ce1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.049524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eaeb9a6b807413898db918b4b2a5551', 'request_id': 'req-7ee6d531-a9c4-4371-8f94-dc21ece52e18'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:50.055424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eaeb9a6b807413898db918b4b2a5551', 'request_id': 'req-7ee6d531-a9c4-4371-8f94-dc21ece52e18'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:50.068908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eaeb9a6b807413898db918b4b2a5551', 'request_id': 'req-7ee6d531-a9c4-4371-8f94-dc21ece52e18'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:50.081897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] The token cache is being invalidate because project 5eaeb9a6b807413898db918b4b2a5551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:16:50.082272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:50.082914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:50.084877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1068/2132] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:49 2022] DELETE /identity/v3/projects/5eaeb9a6b807413898db918b4b2a5551 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:50.085645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.086924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.087609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60b240-3d98-4c2d-ba5d-3f9ef446ce1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.089660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60b240-3d98-4c2d-ba5d-3f9ef446ce1b service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.098997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1065/2133] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:16:50.100505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a648b0-3196-47ef-9b4d-a33fb2dd288f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.100795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a648b0-3196-47ef-9b4d-a33fb2dd288f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.101189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a648b0-3196-47ef-9b4d-a33fb2dd288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.122152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-93a648b0-3196-47ef-9b4d-a33fb2dd288f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:50.123374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-93a648b0-3196-47ef-9b4d-a33fb2dd288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.129047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:50.158877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d531-a9c4-4371-8f94-dc21ece52e18 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.163520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.164241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.164600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.165050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.167574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.204374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:50.219575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1066/2134] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:50.227929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35391e-bc47-4d2c-bb23-58246c3ad968 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.228205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35391e-bc47-4d2c-bb23-58246c3ad968 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.228523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35391e-bc47-4d2c-bb23-58246c3ad968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.250107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9e35391e-bc47-4d2c-bb23-58246c3ad968 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:50.251529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9e35391e-bc47-4d2c-bb23-58246c3ad968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.259718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.260865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1067/2135] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:16:50.265330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35391e-bc47-4d2c-bb23-58246c3ad968 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.265840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.276080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35391e-bc47-4d2c-bb23-58246c3ad968 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.281336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1069/2136] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:50.283149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.283821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.284177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.284442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.285097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:16:50.285407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.287103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.302341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1068/2137] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:16:50.308992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.322794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8957d-8bc2-4c16-917d-0a97eb3fcb7c service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.328460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.329211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.329499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.329833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.330514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.332593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.369206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1070/2138] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:50.373553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.391339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151061a1-7ff7-4916-9cf2-63ff8b5abbf5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.497578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.498264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.498582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.506457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.507609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.511343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.564236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1069/2139] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:50.565481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.589178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f22c57-a0c6-4c8b-a9dd-5013dec7fbbc admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.601559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.602228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.602533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.602930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.603615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.608951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.641184 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1071/2140] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:50.645839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.665899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb30fb5-5179-4ac7-b1e4-c404446a2be9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.671468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f508c-813e-4a6d-b1e2-a97467d8eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.672258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f508c-813e-4a6d-b1e2-a97467d8eaef admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.672544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f508c-813e-4a6d-b1e2-a97467d8eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.672917 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f508c-813e-4a6d-b1e2-a97467d8eaef admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.673572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f508c-813e-4a6d-b1e2-a97467d8eaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.675925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f508c-813e-4a6d-b1e2-a97467d8eaef admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.691884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1070/2141] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:50.695933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:50.710311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa50c7-88d4-49e7-952a-d6372aa6ddb8 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:50.724197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:50.725387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.728158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.729055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] PATH_INFO: `/v3/projects/1f891b1403014c34b55022580a2ab3c8/users/2f27a6920e62404a84dc354f824a09b6/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.790332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f891b1403014c34b55022580a2ab3c8, user_id=2f27a6920e62404a84dc354f824a09b6, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:50.795212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:50.843255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1072/2142] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:50 2022] PUT /identity/v3/projects/1f891b1403014c34b55022580a2ab3c8/users/2f27a6920e62404a84dc354f824a09b6/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:50.853591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572090-169a-4dad-94ae-667054e833c2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:50.853869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572090-169a-4dad-94ae-667054e833c2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:50.854223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd572090-169a-4dad-94ae-667054e833c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:50.893968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cd572090-169a-4dad-94ae-667054e833c2 None None] MFA Rules not processed for user `2f27a6920e62404a84dc354f824a09b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:50.895201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cd572090-169a-4dad-94ae-667054e833c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:50.959406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:50.968280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1071/2143] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:50.974928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.042115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624b773-6a96-45d2-8f29-5cbf3b6c212a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.047095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.047728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.048036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.048310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.048933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.050900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.081655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1073/2144] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:50 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:51.085774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572090-169a-4dad-94ae-667054e833c2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.097303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd572090-169a-4dad-94ae-667054e833c2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.159362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.160232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.160514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.160786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.161486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.163504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.191224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.191877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1072/2145] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:51 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:51.202806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05533108-6ffe-4617-9d7a-1cd4b395bfaf admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.207718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.208366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.208823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.209107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.209754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.211375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.222787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1074/2146] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:16:51.227190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.239302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25480f17-98da-4d97-a64c-71b0a37e7012 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.244214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df45f80-afe9-4058-b2ee-0654d4ea83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.244841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45f80-afe9-4058-b2ee-0654d4ea83f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.245122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45f80-afe9-4058-b2ee-0654d4ea83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.245398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45f80-afe9-4058-b2ee-0654d4ea83f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.246054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45f80-afe9-4058-b2ee-0654d4ea83f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.247665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45f80-afe9-4058-b2ee-0654d4ea83f5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.261985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1073/2147] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:51.267265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.280639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03110201-8ce6-42a7-84d6-40bf6403d0e7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.286087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.286755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.287059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.287313 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] PATH_INFO: `/v3/projects/908eed96b1844340abd4b99caa671417/users/112d85637d8243e7b10d921177b3e29d/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.304449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908eed96b1844340abd4b99caa671417, user_id=112d85637d8243e7b10d921177b3e29d, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.308029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.343845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1075/2148] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:51 2022] PUT /identity/v3/projects/908eed96b1844340abd4b99caa671417/users/112d85637d8243e7b10d921177b3e29d/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:51.359082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165491d-6695-4848-93d6-eeab92bf2015 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.359513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165491d-6695-4848-93d6-eeab92bf2015 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.359789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165491d-6695-4848-93d6-eeab92bf2015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.393189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1165491d-6695-4848-93d6-eeab92bf2015 None None] MFA Rules not processed for user `112d85637d8243e7b10d921177b3e29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:51.394940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1165491d-6695-4848-93d6-eeab92bf2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:51.478380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1074/2149] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:51.482898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.501570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:51.563628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a592-05a2-47e8-ae65-4cd559ef1435 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.568915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.569913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.570174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.570594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.571318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.573863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.617382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1076/2150] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:51 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:51.621599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165491d-6695-4848-93d6-eeab92bf2015 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.652669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165491d-6695-4848-93d6-eeab92bf2015 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.728276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.728930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.729215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.729485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.730132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.732475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.745128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:51.774813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1075/2151] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:51 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:51.778604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.799615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e8ca2-cb86-4f48-ac06-f626cb1ed5aa admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.805567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.807346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.807952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.808359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.809208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.810915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.833302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1077/2152] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:51.834968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.856221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d6317-44b3-4ee3-a1fb-73f6fe677d46 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:51.864972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:51.865700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:51.866039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:51.866470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] PATH_INFO: `/v3/projects/dad6cae11b1f48d4b51d834e104702b5/users/4576720e14ae4d948448def5657f47af/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:51.893828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad6cae11b1f48d4b51d834e104702b5, user_id=4576720e14ae4d948448def5657f47af, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:51.903764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:51.929779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1076/2153] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:51 2022] PUT /identity/v3/projects/dad6cae11b1f48d4b51d834e104702b5/users/4576720e14ae4d948448def5657f47af/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:51.932644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:51.944938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d30bc-b428-4b54-be46-2ad5fade945b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:52.124641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01a2fc-2c4c-40fa-bf56-2877f0d69d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:52.127770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01a2fc-2c4c-40fa-bf56-2877f0d69d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:52.128704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01a2fc-2c4c-40fa-bf56-2877f0d69d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:52.128995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01a2fc-2c4c-40fa-bf56-2877f0d69d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:52.129996 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01a2fc-2c4c-40fa-bf56-2877f0d69d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:52.133429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01a2fc-2c4c-40fa-bf56-2877f0d69d10 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:52.173285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1078/2154] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:52.176248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:52.194160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33982-137c-4b21-9ff8-6e64db079bf1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:52.208619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:52.209559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:52.209559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:52.209559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] PATH_INFO: `/v3/projects/dad6cae11b1f48d4b51d834e104702b5/users/4576720e14ae4d948448def5657f47af/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:52.214613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad6cae11b1f48d4b51d834e104702b5, user_id=4576720e14ae4d948448def5657f47af, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:52.221299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:52.270697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1077/2155] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:52 2022] PUT /identity/v3/projects/dad6cae11b1f48d4b51d834e104702b5/users/4576720e14ae4d948448def5657f47af/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:52.282230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca61220-79c3-4d8e-9385-3e319d013337 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:52.282589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca61220-79c3-4d8e-9385-3e319d013337 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:52.282935 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca61220-79c3-4d8e-9385-3e319d013337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:52.365338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-fca61220-79c3-4d8e-9385-3e319d013337 None None] MFA Rules not processed for user `4576720e14ae4d948448def5657f47af`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:52.372131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-fca61220-79c3-4d8e-9385-3e319d013337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:52.523287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1079/2156] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:52.536128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:52.538460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:52.626434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fbff4-96b8-484c-a59c-f200c71c3cfd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:52.636784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:52.637431 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:52.637713 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:52.637987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:52.762716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:52.767119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:52.780308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1078/2157] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:55.921946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b09ee-acbf-4ec1-a8f9-77cf1d90652f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:55.922524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b09ee-acbf-4ec1-a8f9-77cf1d90652f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:55.922524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b09ee-acbf-4ec1-a8f9-77cf1d90652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:55.942569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:55.954757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-675b09ee-acbf-4ec1-a8f9-77cf1d90652f None None] MFA Rules not processed for user `388379cb8722477fbba3162dcbe3cc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:55.956025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-675b09ee-acbf-4ec1-a8f9-77cf1d90652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:56.062756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1080/2158] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:56.067353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:56.068836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:56.152990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ad359-c524-46d5-b678-14ee781f283a service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:56.158822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:56.159437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:56.159715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:56.160022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:56.160668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:56.162573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:56.184436 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:56.198574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1079/2159] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:16:56 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:56.200509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b09ee-acbf-4ec1-a8f9-77cf1d90652f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:56.212993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b09ee-acbf-4ec1-a8f9-77cf1d90652f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:56.275495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:56.276228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:56.276977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:56.276977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:56.277420 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:56.279418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:56.302438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1081/2160] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:16:56 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:16:56.306497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:56.317904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196cde-3580-4fb3-aec4-405f911db4b6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:56.325336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:56.325938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:56.326218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:56.326486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:56.327916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:56.329715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:56.342317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1080/2161] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:56.346136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:56.357140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f154e-0cb3-495e-a1cc-ccffa3cb66e2 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:56.363118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:56.363853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:56.364270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:56.364562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] PATH_INFO: `/v3/projects/84eaf954cdfd46abac824354fd9b0e2b/users/6a6bf9baf4174876b40923cb5cbc6a34/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:56.385121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eaf954cdfd46abac824354fd9b0e2b, user_id=6a6bf9baf4174876b40923cb5cbc6a34, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:56.388450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:56.411021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1082/2162] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:56 2022] PUT /identity/v3/projects/84eaf954cdfd46abac824354fd9b0e2b/users/6a6bf9baf4174876b40923cb5cbc6a34/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:56.415140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:56.431451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885cc6-79b5-4b4e-b866-fe2c2d081724 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:56.493775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:56.494397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:56.494680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:56.494956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:56.495616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:56.497256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:56.507858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1081/2163] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:16:56.511850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:56.523029 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d6ee-8c6d-4f32-bde8-7ee2ef65118f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:56.527530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:56.528219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:56.528498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:56.528768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] PATH_INFO: `/v3/projects/84eaf954cdfd46abac824354fd9b0e2b/users/6a6bf9baf4174876b40923cb5cbc6a34/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:56.531072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eaf954cdfd46abac824354fd9b0e2b, user_id=6a6bf9baf4174876b40923cb5cbc6a34, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:56.533737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:56.544201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1083/2164] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:16:56 2022] PUT /identity/v3/projects/84eaf954cdfd46abac824354fd9b0e2b/users/6a6bf9baf4174876b40923cb5cbc6a34/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:16:58.209245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:58.310622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f8d9-1a05-45cb-a0a7-670e1c3ae844 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:58.375219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:58.378146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:58.382088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707d3f1-a1fa-47b7-90ff-3b4fa603bd13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:58.382724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707d3f1-a1fa-47b7-90ff-3b4fa603bd13 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:58.383008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707d3f1-a1fa-47b7-90ff-3b4fa603bd13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:58.383449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707d3f1-a1fa-47b7-90ff-3b4fa603bd13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:58.457756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:58.465159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:58.471897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707d3f1-a1fa-47b7-90ff-3b4fa603bd13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:58.473414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707d3f1-a1fa-47b7-90ff-3b4fa603bd13 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:58.485153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1082/2165] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:58.494212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180bb89-3ed0-4a68-b996-b8669e4b5755 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:58.501214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:58.502005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:58.502352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:58.502697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] PATH_INFO: `/v3/users/d19bedf7986d49c2aa5d0c7d3b38973d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:58.503963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19bedf7986d49c2aa5d0c7d3b38973d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:58.505981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:58.590156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19bedf7986d49c2aa5d0c7d3b38973d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:58.591045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19bedf7986d49c2aa5d0c7d3b38973d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:58.593728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19bedf7986d49c2aa5d0c7d3b38973d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:58.621182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19bedf7986d49c2aa5d0c7d3b38973d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:58.635270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19bedf7986d49c2aa5d0c7d3b38973d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:16:58.656674 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1084/2166] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:16:58 2022] DELETE /identity/v3/users/d19bedf7986d49c2aa5d0c7d3b38973d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:16:58.661252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:58.661606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:58.661947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:58.693319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:58.695169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:58.800044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1083/2167] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:58.808692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:58.810737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:58.943495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e8a19-d8f3-42dc-b25d-5b1e1a34c016 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:58.949256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:58.950264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:58.951404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:58.952508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:58.965906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:58.967570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:58.979508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1085/2168] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:59.598100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:59.599914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:59.753069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12f95a-bf3f-447a-b0b5-0f14a140a99e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:59.757705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:59.758510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:59.758900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:59.759283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:59.761545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:59.829415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:16:59.831782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:59.865477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0ff4b-4b45-401d-ab24-4015e8c59693 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:16:59.876129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:16:59.879553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:59.880675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:59.883293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] PATH_INFO: `/v3/projects/5576d416db0b4ae190ecdcb20e8b8906` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:59.885858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5576d416db0b4ae190ecdcb20e8b8906)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:59.895991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:59.920275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:16:59.922072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:16:59.953067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1084/2169] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:16:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:59.996400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5576d416db0b4ae190ecdcb20e8b8906', 'request_id': 'req-335394a3-bb58-442b-b0da-f68fcb84c2ec'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.005465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5576d416db0b4ae190ecdcb20e8b8906', 'request_id': 'req-335394a3-bb58-442b-b0da-f68fcb84c2ec'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.017659 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5576d416db0b4ae190ecdcb20e8b8906', 'request_id': 'req-335394a3-bb58-442b-b0da-f68fcb84c2ec'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.020936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:00.035199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] The token cache is being invalidate because project 5576d416db0b4ae190ecdcb20e8b8906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:00.035787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.036943 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.044287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:00.047224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1086/2170] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:16:59 2022] DELETE /identity/v3/projects/5576d416db0b4ae190ecdcb20e8b8906 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:00.060353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c609d-0f4a-48c8-b1f4-14b8fe408d5b service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:00.158479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:00.201346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:00.202622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:00.202902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:00.203173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] PATH_INFO: `/v3/users/a5f3f7b7930447f1adef4bf40167ca99` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:00.204469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f3f7b7930447f1adef4bf40167ca99)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:00.206543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:00.307438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f3f7b7930447f1adef4bf40167ca99'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.323948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f3f7b7930447f1adef4bf40167ca99'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.324884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f3f7b7930447f1adef4bf40167ca99'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.359968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f3f7b7930447f1adef4bf40167ca99'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.377510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-168d942a-0902-4049-a564-50eb0e871118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f3f7b7930447f1adef4bf40167ca99'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:00.386801 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1085/2171] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:00 2022] DELETE /identity/v3/users/a5f3f7b7930447f1adef4bf40167ca99 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:01.297245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:01.298841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:01.351287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335394a3-bb58-442b-b0da-f68fcb84c2ec admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:01.524075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:01.524740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:01.525019 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:01.525295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] PATH_INFO: `/v3/users/237f39d6f921423e92e98c135808f4b1` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:01.532096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=237f39d6f921423e92e98c135808f4b1)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:01.534153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:01.685393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237f39d6f921423e92e98c135808f4b1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:01.686658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237f39d6f921423e92e98c135808f4b1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:01.688238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237f39d6f921423e92e98c135808f4b1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:01.740707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237f39d6f921423e92e98c135808f4b1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:01.762803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237f39d6f921423e92e98c135808f4b1'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:01.803258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1087/2172] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:01 2022] DELETE /identity/v3/users/237f39d6f921423e92e98c135808f4b1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:01.807773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:01.808272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:01.808378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:01.844285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:01.845551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:01.959521 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:01.961034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:02.026188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1086/2173] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:02.075030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:02.076457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:02.149129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dd4d5-533e-490b-bdf5-0216db92d3cb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:02.164330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:02.166478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:02.166890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:02.167344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] PATH_INFO: `/v3/projects/a0561d4d40594528af674b4304d7132c` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:02.170000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0561d4d40594528af674b4304d7132c)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:02.176845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:02.232259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:02.243989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbe02d-d7ea-4768-b9e9-3c007457fabc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:02.266517 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626b95-09af-4d66-a84a-01f2de644c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:02.267198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626b95-09af-4d66-a84a-01f2de644c92 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:02.267528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626b95-09af-4d66-a84a-01f2de644c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:02.267926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626b95-09af-4d66-a84a-01f2de644c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:02.294381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626b95-09af-4d66-a84a-01f2de644c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:02.303239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3626b95-09af-4d66-a84a-01f2de644c92 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:02.323278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0561d4d40594528af674b4304d7132c', 'request_id': 'req-9f0c2613-fcc5-49b8-8eb8-35cce708747f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:02.337405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0561d4d40594528af674b4304d7132c', 'request_id': 'req-9f0c2613-fcc5-49b8-8eb8-35cce708747f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:02.341243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1087/2174] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:02.360800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0561d4d40594528af674b4304d7132c', 'request_id': 'req-9f0c2613-fcc5-49b8-8eb8-35cce708747f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:02.388197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] The token cache is being invalidate because project a0561d4d40594528af674b4304d7132c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:02.388501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:02.390324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f0c2613-fcc5-49b8-8eb8-35cce708747f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:02.398046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1088/2175] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:01 2022] DELETE /identity/v3/projects/a0561d4d40594528af674b4304d7132c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:02.399645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a177d-3638-4fdb-9b06-082c72cf2367 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:02.401101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a177d-3638-4fdb-9b06-082c72cf2367 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:02.401391 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a177d-3638-4fdb-9b06-082c72cf2367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:02.428106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:02.461867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6f4a177d-3638-4fdb-9b06-082c72cf2367 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:02.463294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6f4a177d-3638-4fdb-9b06-082c72cf2367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:02.626676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1088/2176] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:02.632969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d625eb9-007c-4cd9-aa1b-8ee5255d7f11 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:02.633256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d625eb9-007c-4cd9-aa1b-8ee5255d7f11 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:02.633534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d625eb9-007c-4cd9-aa1b-8ee5255d7f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:02.688080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6d625eb9-007c-4cd9-aa1b-8ee5255d7f11 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:02.690627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6d625eb9-007c-4cd9-aa1b-8ee5255d7f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:02.703603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1089/2177] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:02.708394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a177d-3638-4fdb-9b06-082c72cf2367 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:02.722512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a177d-3638-4fdb-9b06-082c72cf2367 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:02.728812 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:02.730252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:02.730791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:02.731473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:02.732429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:02.733004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:02.735104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:02.767829 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1089/2178] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:02.776051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d625eb9-007c-4cd9-aa1b-8ee5255d7f11 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:02.788672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d625eb9-007c-4cd9-aa1b-8ee5255d7f11 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:02.800974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:02.802201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:02.802818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:02.803116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:02.808183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:02.815376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:02.901056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1090/2179] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:02 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:02.904001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:02.947840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214401-b19a-40c4-82e9-a780c9121149 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:03.159577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:03.160443 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:03.160821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:03.161252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:03.162271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:03.165534 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:03.226152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1090/2180] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:02 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:03.230384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:03.260193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ab0bb-34ba-4581-8e62-d5ec40758ba1 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:03.294573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:03.295968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:03.300759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:03.301176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:03.307906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:03.307906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:03.330965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:03.336303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1091/2181] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:03.353522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358222-b41e-4f10-bde0-8f14a9ff04f9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:03.371474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7aaf5-4725-43ee-9a3c-66b771d854a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:03.372236 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7aaf5-4725-43ee-9a3c-66b771d854a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:03.373049 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7aaf5-4725-43ee-9a3c-66b771d854a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:03.375505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7aaf5-4725-43ee-9a3c-66b771d854a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:03.376348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7aaf5-4725-43ee-9a3c-66b771d854a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:03.378104 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7aaf5-4725-43ee-9a3c-66b771d854a3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:03.416902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1091/2182] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:03.422010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:03.442929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f48c4-2ea1-4249-8eab-a02e0dd2560c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:03.455154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5d4a9-8836-439c-af3a-edd8a3ea4a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:03.464573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5d4a9-8836-439c-af3a-edd8a3ea4a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:03.465168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5d4a9-8836-439c-af3a-edd8a3ea4a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:03.465761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5d4a9-8836-439c-af3a-edd8a3ea4a3d admin admin] PATH_INFO: `/v3/projects/99811b4cb3fb4931958d0a360aba306b/users/6f7813698a58481c8f630636ff16721f/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:03.498880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5d4a9-8836-439c-af3a-edd8a3ea4a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99811b4cb3fb4931958d0a360aba306b, user_id=6f7813698a58481c8f630636ff16721f, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:03.508772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5d4a9-8836-439c-af3a-edd8a3ea4a3d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:03.560779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1092/2183] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:03 2022] PUT /identity/v3/projects/99811b4cb3fb4931958d0a360aba306b/users/6f7813698a58481c8f630636ff16721f/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:03.563503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753413-a202-48ac-8b6d-aa9d7ad50170 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:03.563969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753413-a202-48ac-8b6d-aa9d7ad50170 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:03.564315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1753413-a202-48ac-8b6d-aa9d7ad50170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:03.617824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:03.618478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:03.619641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:03.627397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e1753413-a202-48ac-8b6d-aa9d7ad50170 None None] MFA Rules not processed for user `6f7813698a58481c8f630636ff16721f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:03.630027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e1753413-a202-48ac-8b6d-aa9d7ad50170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:03.701069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] MFA Rules not processed for user `6a6bf9baf4174876b40923cb5cbc6a34`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:03.703226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:03.852107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1092/2184] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:03.856724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1753413-a202-48ac-8b6d-aa9d7ad50170 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:03.870381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:03.915669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1093/2185] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:03.927851 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:03.929303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:03.999186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:04.069026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd900b-2163-4f01-8333-59c075ca47cf None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:04.074350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009c623055dc4defa2bd74a82c6a7e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:04.075024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.075375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.075955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.079916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:04.091500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1753413-a202-48ac-8b6d-aa9d7ad50170 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:04.098664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:04.100800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.101462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.101961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.103089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:04.105959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:04.173636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1093/2186] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:03 2022] POST /identity/v3/projects => generated 365 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:04.173826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:04.177525 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:04.200607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:04.202690 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:04.239224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1094/2187] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:04.240307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:04.277692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa07ee-9752-472d-a862-97edf6c986bc service glance] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:04.308548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c39939-e9e9-4cd0-b122-5ccdb3823251 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:04.324484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:04.325280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.325676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.325965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] PATH_INFO: `/v3/projects/cc7e667f3b04440b95d7e2deb23e4b2c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.328233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7e667f3b04440b95d7e2deb23e4b2c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:04.333504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:04.436450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:04.437078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.437078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.437457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.437828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:04.441122 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:04.454135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7e667f3b04440b95d7e2deb23e4b2c', 'request_id': 'req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.463224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7e667f3b04440b95d7e2deb23e4b2c', 'request_id': 'req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.484485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1095/2188] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:04 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:04.489489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:04.508136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7e667f3b04440b95d7e2deb23e4b2c', 'request_id': 'req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.516217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017418c4-4c6a-4caf-b034-ba44bfc1ecd1 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:04.551417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] The token cache is being invalidate because project cc7e667f3b04440b95d7e2deb23e4b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:04.551704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.557893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.564871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1094/2189] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:04 2022] DELETE /identity/v3/projects/cc7e667f3b04440b95d7e2deb23e4b2c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:04.568710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:04.571717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:04.641057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:04.651461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99243a8a-c2d6-4b93-8d89-b480e97f6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:04.652165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243a8a-c2d6-4b93-8d89-b480e97f6ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.652466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243a8a-c2d6-4b93-8d89-b480e97f6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.652726 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99243a8a-c2d6-4b93-8d89-b480e97f6ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.653455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99243a8a-c2d6-4b93-8d89-b480e97f6ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:04.656134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99243a8a-c2d6-4b93-8d89-b480e97f6ae4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:04.671920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1096/2190] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:04.671920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.671920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.671920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.687610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:04.700576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:04.702703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:04.718202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca657cf7-0c07-4a3c-b7e8-7e4f025fe8d4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:04.723416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:04.724189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.724838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.725232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] PATH_INFO: `/v3/users/40e3769ba0564ae3a62b5d8c425ad416` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.726516 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e3769ba0564ae3a62b5d8c425ad416)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:04.728680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:04.788544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e3769ba0564ae3a62b5d8c425ad416'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.788828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1097/2191] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:04.789820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:04.791871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:04.806503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e3769ba0564ae3a62b5d8c425ad416'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.808383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e3769ba0564ae3a62b5d8c425ad416'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.825926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfdeb2-6ac2-4dec-8b2e-15d90cdb4ddf None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:04.836495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:04.837732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:04.838277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:04.838415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e3769ba0564ae3a62b5d8c425ad416'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.839246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] PATH_INFO: `/v3/projects/157dd1ff3e5f4c539a42b2a856138a09/users/1379d921b9a744be8b873abe9258fa30/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:04.858388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e3769ba0564ae3a62b5d8c425ad416'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:04.869568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=157dd1ff3e5f4c539a42b2a856138a09, user_id=1379d921b9a744be8b873abe9258fa30, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:04.872624 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1095/2192] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:04 2022] DELETE /identity/v3/users/40e3769ba0564ae3a62b5d8c425ad416 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:04.872624 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:04.873873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:04.891429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:04.937938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1098/2193] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:04 2022] PUT /identity/v3/projects/157dd1ff3e5f4c539a42b2a856138a09/users/1379d921b9a744be8b873abe9258fa30/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:04.945939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:04.950024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:05.053308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab92765-f5ae-469d-8e7d-002672e8cc80 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:05.116430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c74235-99af-47f3-a8f8-3e01ec721f4a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:05.124847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:05.125806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:05.126257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:05.126709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:05.128076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:05.130905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:05.169139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1099/2194] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:05.171644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:05.174466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:05.185035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:05.217993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9ddae-3502-4ba1-a8b4-87ad484a8a6f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:05.228507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:05.229656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:05.230192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:05.230599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] PATH_INFO: `/v3/users/2f27a6920e62404a84dc354f824a09b6` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:05.232534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f27a6920e62404a84dc354f824a09b6)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:05.237210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:05.270524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:05.271383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:05.271924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:05.272451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:05.275150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:05.375879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f27a6920e62404a84dc354f824a09b6'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:05.376634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f27a6920e62404a84dc354f824a09b6'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:05.385022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f27a6920e62404a84dc354f824a09b6'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:05.410254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f27a6920e62404a84dc354f824a09b6'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:05.413080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:05.415586 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:05.422419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-79a8b8b1-1c6d-47e6-a4fc-37e553a45c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f27a6920e62404a84dc354f824a09b6'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:05.426626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:05.430761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1096/2195] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:17:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:17:05.443079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:05.446604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1100/2196] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:05 2022] DELETE /identity/v3/users/2f27a6920e62404a84dc354f824a09b6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:05.451892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:05.451892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:05.453299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:05.465831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3c1a1-e81f-4b80-b90a-bbec83ade0b8 service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:05.536344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:05.540735 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:05.677565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:05.678090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:05.678383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:05.678656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] PATH_INFO: `/v3/projects/157dd1ff3e5f4c539a42b2a856138a09/users/1379d921b9a744be8b873abe9258fa30/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:05.684496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157dd1ff3e5f4c539a42b2a856138a09, user_id=1379d921b9a744be8b873abe9258fa30, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:05.687409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:05.713763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1101/2197] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:05.714318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:05.715827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:05.719440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1097/2198] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:05 2022] PUT /identity/v3/projects/157dd1ff3e5f4c539a42b2a856138a09/users/1379d921b9a744be8b873abe9258fa30/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:05.724880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:05.730457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:05.762229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb16fe-beec-4b19-9510-cfea276355fc None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:05.892959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc7c2f-83f8-4d7b-a2be-9a3288e7adc4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:05.907960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ca8e8-9767-4da9-8e41-d2f84614500f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:05.909332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ca8e8-9767-4da9-8e41-d2f84614500f service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:05.909727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ca8e8-9767-4da9-8e41-d2f84614500f service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:05.910112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ca8e8-9767-4da9-8e41-d2f84614500f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:05.981933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:05.990118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:05.991601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:05.992103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:05.992861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] PATH_INFO: `/v3/projects/51d3bb78dd0944cfbf479ab2fb1b6d12` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:05.997119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d3bb78dd0944cfbf479ab2fb1b6d12)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:06.001152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:06.070925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ca8e8-9767-4da9-8e41-d2f84614500f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:06.073120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ca8e8-9767-4da9-8e41-d2f84614500f service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:06.121657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1098/2199] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:06.125642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:06.126322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:06.127245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:06.146998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d3bb78dd0944cfbf479ab2fb1b6d12', 'request_id': 'req-359d403f-2fda-4519-b959-4012f091b3ed'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:06.173881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d3bb78dd0944cfbf479ab2fb1b6d12', 'request_id': 'req-359d403f-2fda-4519-b959-4012f091b3ed'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:06.197992 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d3bb78dd0944cfbf479ab2fb1b6d12', 'request_id': 'req-359d403f-2fda-4519-b959-4012f091b3ed'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:06.210025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] MFA Rules not processed for user `1379d921b9a744be8b873abe9258fa30`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:06.214169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:06.219090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] The token cache is being invalidate because project 51d3bb78dd0944cfbf479ab2fb1b6d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:06.221139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:06.230547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-359d403f-2fda-4519-b959-4012f091b3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:06.235462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1102/2200] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:05 2022] DELETE /identity/v3/projects/51d3bb78dd0944cfbf479ab2fb1b6d12 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:06.241362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08a77-f897-4545-810c-3713c45d25d5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:06.241822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08a77-f897-4545-810c-3713c45d25d5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:06.242259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08a77-f897-4545-810c-3713c45d25d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:06.302678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-bbb08a77-f897-4545-810c-3713c45d25d5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:06.306249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bbb08a77-f897-4545-810c-3713c45d25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:06.383956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:06.385869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1099/2201] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:06.401751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:06.403997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:06.510744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1103/2202] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:06.516304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63ae5-e487-49bf-aeab-02b1dab70824 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:06.516595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63ae5-e487-49bf-aeab-02b1dab70824 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:06.516874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df63ae5-e487-49bf-aeab-02b1dab70824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:06.553833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0add9d-7229-4881-8c9a-e3403974817d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:06.560563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6df63ae5-e487-49bf-aeab-02b1dab70824 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:06.563176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6df63ae5-e487-49bf-aeab-02b1dab70824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:06.564470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:06.565105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:06.565384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:06.565656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:06.578680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1104/2203] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:06.578902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:06.581621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:06.583196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63ae5-e487-49bf-aeab-02b1dab70824 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:06.596005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1100/2204] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:06.620610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df63ae5-e487-49bf-aeab-02b1dab70824 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:06.637991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:06.643151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:06.643479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:06.644889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:06.645599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:06.647304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:06.653511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:06.724260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1105/2205] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:06.725951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:06.752492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510b747-82af-4479-a4ee-dd8fd7e06ceb service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:06.758164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:06.765138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:06.765669 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:06.765949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:06.766224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:06.767508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:06.775086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:06.786115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c29ca2-bd0b-4aca-b7ad-49907127d15a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:06.805995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:06.811610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:06.812061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:06.814026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:06.826451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:06.850641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1101/2206] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:06 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:06.859868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:07.012864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:07.032587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:07.034197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:07.052254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1106/2207] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:07.058210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:07.064101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:07.082871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb76e-9c7a-43bd-aa5e-5389b6904bea admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:07.107336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbddcf-586b-435e-a289-a1d32d5f28fd service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:07.108398 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:07.109032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:07.109315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:07.109592 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:07.110263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:07.112495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:07.118230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:07.118831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:07.119108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:07.119980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] PATH_INFO: `/v3/projects/1f891b1403014c34b55022580a2ab3c8` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:07.122227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f891b1403014c34b55022580a2ab3c8)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:07.126752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:07.177552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1102/2208] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:06 2022] POST /identity/v3/users => generated 285 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:07.178951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:07.216131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60ed76-e0ba-48d6-8c03-382396e128c8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:07.262493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f891b1403014c34b55022580a2ab3c8', 'request_id': 'req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.296328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f891b1403014c34b55022580a2ab3c8', 'request_id': 'req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.319198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f891b1403014c34b55022580a2ab3c8', 'request_id': 'req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.356304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] The token cache is being invalidate because project 1f891b1403014c34b55022580a2ab3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:07.357124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.359526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.366514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1107/2209] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:07 2022] DELETE /identity/v3/projects/1f891b1403014c34b55022580a2ab3c8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:07.371252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:07.375758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:07.514838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:07.520720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:07.521526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:07.521813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:07.522098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:07.522777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:07.535483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:07.584247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1103/2210] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:07.589438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:07.598896 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:07.621570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d952cc-2fbc-4195-aa88-a2ec3d6ec730 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:07.635911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:07.636647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:07.636930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:07.637201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] PATH_INFO: `/v3/users/112d85637d8243e7b10d921177b3e29d` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:07.642170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=112d85637d8243e7b10d921177b3e29d)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:07.646400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:07.658761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd975ad-9756-457f-8955-755d89ec572f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:07.686670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:07.687316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:07.687603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:07.687926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:07.688579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:07.699472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:07.747677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1104/2211] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:07.757130 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:07.799768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112d85637d8243e7b10d921177b3e29d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.806421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112d85637d8243e7b10d921177b3e29d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.807051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112d85637d8243e7b10d921177b3e29d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.807221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d211c5-0328-45aa-825b-a80473276868 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:07.831877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205b486-8a40-4123-8c93-150bdf225579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:07.838068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b486-8a40-4123-8c93-150bdf225579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:07.838068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b486-8a40-4123-8c93-150bdf225579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:07.838068 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b486-8a40-4123-8c93-150bdf225579 admin admin] PATH_INFO: `/v3/projects/c9df4d17280145ab81d92a49fba86033/users/dd15b13137854780a1c36e33b45ffa61/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:07.869526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205b486-8a40-4123-8c93-150bdf225579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9df4d17280145ab81d92a49fba86033, user_id=dd15b13137854780a1c36e33b45ffa61, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:07.876200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205b486-8a40-4123-8c93-150bdf225579 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:07.890241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112d85637d8243e7b10d921177b3e29d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.915225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112d85637d8243e7b10d921177b3e29d'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:07.941477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1105/2212] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:07 2022] PUT /identity/v3/projects/c9df4d17280145ab81d92a49fba86033/users/dd15b13137854780a1c36e33b45ffa61/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:07.959570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f97ef-c785-4a2d-906b-e4cbeb627c33 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:07.969506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1108/2213] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:07 2022] DELETE /identity/v3/users/112d85637d8243e7b10d921177b3e29d => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:07.984340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f97ef-c785-4a2d-906b-e4cbeb627c33 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:07.984714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f97ef-c785-4a2d-906b-e4cbeb627c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:08.146407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-754f97ef-c785-4a2d-906b-e4cbeb627c33 None None] MFA Rules not processed for user `dd15b13137854780a1c36e33b45ffa61`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:08.147738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-754f97ef-c785-4a2d-906b-e4cbeb627c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:08.445916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:08.447952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:08.453020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1106/2214] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:08.554556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d432d12-4cbe-4827-8775-f4efeb903e8f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:08.565786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:08.566491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:08.566776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:08.567050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:08.567783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:08.569769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:08.616023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f97ef-c785-4a2d-906b-e4cbeb627c33 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:08.623622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1109/2215] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:08 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:08.631700 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f97ef-c785-4a2d-906b-e4cbeb627c33 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:08.653967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:08.750416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:08.751414 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:08.751998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:08.752496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:08.754784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:08.770311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:08.848927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1107/2216] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:08 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:08.850927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:08.869567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7186ca-1a44-41b0-8e46-f0a2b369b4fc admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:08.882811 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:08.884189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:08.884468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:08.884742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:08.885423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:08.887087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:08.930329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1110/2217] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:08.933159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:08.956066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b952-bdbd-4063-afb2-7d50a065a419 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:08.967382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:08.968106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:08.968772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:08.969532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] PATH_INFO: `/v3/projects/047238d156824568b5eb13a0f5b796b5/users/e7c27ea2a2a84703ae7ae0c718ec039e/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:09.014389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=047238d156824568b5eb13a0f5b796b5, user_id=e7c27ea2a2a84703ae7ae0c718ec039e, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:09.025351 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:09.076894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1108/2218] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:08 2022] PUT /identity/v3/projects/047238d156824568b5eb13a0f5b796b5/users/e7c27ea2a2a84703ae7ae0c718ec039e/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:09.081269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:09.096955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b0c13-a6fb-42ae-8323-ff28baface64 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:09.163881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:09.262781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ffdfb-bf78-4c69-b43a-ba601da26bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:09.264755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ffdfb-bf78-4c69-b43a-ba601da26bff admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:09.265223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ffdfb-bf78-4c69-b43a-ba601da26bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:09.265995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ffdfb-bf78-4c69-b43a-ba601da26bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:09.267071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ffdfb-bf78-4c69-b43a-ba601da26bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:09.269859 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ffdfb-bf78-4c69-b43a-ba601da26bff admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:09.295778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1111/2219] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:09.313991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:09.330445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e2960-b332-4e39-9ef3-d563fd2f2a44 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:09.346782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944565b-f3f0-441a-bc29-01f3b76f69fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:09.347833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944565b-f3f0-441a-bc29-01f3b76f69fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:09.347833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944565b-f3f0-441a-bc29-01f3b76f69fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:09.348480 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944565b-f3f0-441a-bc29-01f3b76f69fb admin admin] PATH_INFO: `/v3/projects/047238d156824568b5eb13a0f5b796b5/users/e7c27ea2a2a84703ae7ae0c718ec039e/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:09.387763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944565b-f3f0-441a-bc29-01f3b76f69fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=047238d156824568b5eb13a0f5b796b5, user_id=e7c27ea2a2a84703ae7ae0c718ec039e, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:09.394824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944565b-f3f0-441a-bc29-01f3b76f69fb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:09.430982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1109/2220] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:09 2022] PUT /identity/v3/projects/047238d156824568b5eb13a0f5b796b5/users/e7c27ea2a2a84703ae7ae0c718ec039e/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:09.432698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:09.435496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:09.435496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:09.496687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13006-16b1-432b-8ff8-118cdb19c11f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:09.497298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13006-16b1-432b-8ff8-118cdb19c11f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:09.497298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13006-16b1-432b-8ff8-118cdb19c11f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:09.498666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1110/2221] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:17:09.522182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] MFA Rules not processed for user `e7c27ea2a2a84703ae7ae0c718ec039e`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:09.522412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:09.522412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:09.522412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:09.524334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:09.582164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] MFA Rules not processed for user `1b4c5c17981649e8a4cffdb84cda0374`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:09.589454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:09.787192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1112/2222] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:09.788107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:09.793549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:09.846167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1111/2223] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:09.846802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:09.850880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:09.995381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c1225-40fb-4fdd-af52-051ff94b1be2 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:10.010695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:10.011447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:10.011732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:10.012135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] PATH_INFO: `/v3/projects/908eed96b1844340abd4b99caa671417` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:10.013414 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908eed96b1844340abd4b99caa671417)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:10.016145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:10.032941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba1d71-d29d-4f45-b0f5-10c5a1c0a8cd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:10.036989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:10.037720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:10.038097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:10.038603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:10.054382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:10.056190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:10.070210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1112/2224] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:10.072976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:10.075038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:10.090849 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:10.105746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf053-dbff-40a3-9280-b5793c35535f service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:10.117947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:10.126413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908eed96b1844340abd4b99caa671417', 'request_id': 'req-31531060-1997-4a49-b4f7-62162f4bc055'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.151381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908eed96b1844340abd4b99caa671417', 'request_id': 'req-31531060-1997-4a49-b4f7-62162f4bc055'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.166611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908eed96b1844340abd4b99caa671417', 'request_id': 'req-31531060-1997-4a49-b4f7-62162f4bc055'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.222450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] The token cache is being invalidate because project 908eed96b1844340abd4b99caa671417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:10.224868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.226827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.232814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1113/2225] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:09 2022] DELETE /identity/v3/projects/908eed96b1844340abd4b99caa671417 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:10.238218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:10.242405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:10.261589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:10.262250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:10.262658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:10.262941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] PATH_INFO: `/v3/users/d8f2a3a6a0bc461d9e7ba14c8a037b59` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:10.264963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f2a3a6a0bc461d9e7ba14c8a037b59)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:10.270437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:10.401260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f2a3a6a0bc461d9e7ba14c8a037b59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.404987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531060-1997-4a49-b4f7-62162f4bc055 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:10.414072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:10.414710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:10.415485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:10.415937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:10.419112 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:10.430915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f2a3a6a0bc461d9e7ba14c8a037b59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.432071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f2a3a6a0bc461d9e7ba14c8a037b59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.439110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:10.441188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:10.463060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1114/2226] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:10.464240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:10.465944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:10.471435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f2a3a6a0bc461d9e7ba14c8a037b59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.487260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f2a3a6a0bc461d9e7ba14c8a037b59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.501521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1113/2227] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:10 2022] DELETE /identity/v3/users/d8f2a3a6a0bc461d9e7ba14c8a037b59 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:10.502556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:10.504662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:10.542101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c03cd-ae9d-4d96-8a23-7af4a173040e service placement] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:10.618914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:10.619893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:10.622149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:10.622510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:10.626444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:10.675349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a2032-0019-4d76-9b58-aca6e65239bd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:10.687740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:10.689044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:10.689289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:10.689575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] PATH_INFO: `/v3/users/4576720e14ae4d948448def5657f47af` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:10.690801 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4576720e14ae4d948448def5657f47af)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:10.692920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:10.716318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:10.743963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:10.805413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4576720e14ae4d948448def5657f47af'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.819389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:10.825522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:10.825721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4576720e14ae4d948448def5657f47af'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.827017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4576720e14ae4d948448def5657f47af'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.846999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1115/2228] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:10.899657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:10.902078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:10.910216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4576720e14ae4d948448def5657f47af'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.923604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a20b-5c26-4bfb-8894-a2600a106107 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:10.930266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:10.931117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:10.932596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:10.933708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] PATH_INFO: `/v3/projects/0fef305b90d942ea823ca9ba799bb9af` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:10.934288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a77b565a-73d9-4318-80a6-5ab117807c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4576720e14ae4d948448def5657f47af'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:10.936954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fef305b90d942ea823ca9ba799bb9af)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:10.941720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:10.952926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1114/2229] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:10 2022] DELETE /identity/v3/users/4576720e14ae4d948448def5657f47af => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:11.084850 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fef305b90d942ea823ca9ba799bb9af', 'request_id': 'req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:11.121195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fef305b90d942ea823ca9ba799bb9af', 'request_id': 'req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:11.172016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fef305b90d942ea823ca9ba799bb9af', 'request_id': 'req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:11.199188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] The token cache is being invalidate because project 0fef305b90d942ea823ca9ba799bb9af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:11.200775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:11.203233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0fd960d9-a9ad-4161-9446-0ca2ce81f5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:11.211712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1116/2230] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:10 2022] DELETE /identity/v3/projects/0fef305b90d942ea823ca9ba799bb9af => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:11.213683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13689-a0c5-437d-a9f0-a0811416ac56 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:11.214229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13689-a0c5-437d-a9f0-a0811416ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:11.214750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13689-a0c5-437d-a9f0-a0811416ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:11.262803 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-20d13689-a0c5-437d-a9f0-a0811416ac56 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:11.267056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-20d13689-a0c5-437d-a9f0-a0811416ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:11.463749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1115/2231] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:11.473374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb787-4769-40a7-b3ae-d2b12ff311b5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:11.474039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb787-4769-40a7-b3ae-d2b12ff311b5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:11.474697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb787-4769-40a7-b3ae-d2b12ff311b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:11.586021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-8eddb787-4769-40a7-b3ae-d2b12ff311b5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:11.587322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8eddb787-4769-40a7-b3ae-d2b12ff311b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:11.633945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1117/2232] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:11.637826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d13689-a0c5-437d-a9f0-a0811416ac56 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:11.655827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d13689-a0c5-437d-a9f0-a0811416ac56 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:11.667463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:11.668428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:11.671340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:11.671834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:11.673419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:11.674573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:11.680614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:11.707197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1116/2233] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:11.710193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddb787-4769-40a7-b3ae-d2b12ff311b5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:11.726484 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddb787-4769-40a7-b3ae-d2b12ff311b5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:11.756539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:11.757176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:11.757457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:11.757737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:11.765993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:11.766991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:11.767924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:11.775752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:11.814920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb1be-5305-43d9-8f2c-0281a2dc9cd5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:11.870272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1118/2234] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:11 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:11.870862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:11.871329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:11.871614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:11.871918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] PATH_INFO: `/v3/projects/dad6cae11b1f48d4b51d834e104702b5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:11.873572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad6cae11b1f48d4b51d834e104702b5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:11.874373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:11.875530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:11.992470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad6cae11b1f48d4b51d834e104702b5', 'request_id': 'req-36abae1a-755d-4ddb-a262-d456edff1eb1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:12.004074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad6cae11b1f48d4b51d834e104702b5', 'request_id': 'req-36abae1a-755d-4ddb-a262-d456edff1eb1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:12.022635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad6cae11b1f48d4b51d834e104702b5', 'request_id': 'req-36abae1a-755d-4ddb-a262-d456edff1eb1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:12.040742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] The token cache is being invalidate because project dad6cae11b1f48d4b51d834e104702b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:12.041241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:12.042298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-36abae1a-755d-4ddb-a262-d456edff1eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:12.045120 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1117/2235] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:11 2022] DELETE /identity/v3/projects/dad6cae11b1f48d4b51d834e104702b5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:12.049992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcae76-f4ab-42d1-8886-d5c5624ab964 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.050463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcae76-f4ab-42d1-8886-d5c5624ab964 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.050913 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcae76-f4ab-42d1-8886-d5c5624ab964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.052316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a65e1-25bc-44bc-b5e5-2a2b3e7e674f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.105797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d1dcae76-f4ab-42d1-8886-d5c5624ab964 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:12.108011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d1dcae76-f4ab-42d1-8886-d5c5624ab964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:12.116894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:12.119446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:12.182026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.182655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.182933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.183209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.184022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.186518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.214813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1118/2236] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:12.228719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c32e-ac5c-486c-8fc9-a21a2baf55ab None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.229165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c32e-ac5c-486c-8fc9-a21a2baf55ab None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.229531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c32e-ac5c-486c-8fc9-a21a2baf55ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.243839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1119/2237] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:11 2022] POST /identity/v3/users => generated 284 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:12.244839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.246878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:12.266006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b33bc-e9db-4b33-8c57-2dbe94e5d4e6 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.267249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ac47c32e-ac5c-486c-8fc9-a21a2baf55ab None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:12.268707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ac47c32e-ac5c-486c-8fc9-a21a2baf55ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:12.271117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.271724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.272041 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.272298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.272988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.274540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.278665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1119/2238] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:12.283858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c32e-ac5c-486c-8fc9-a21a2baf55ab None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.295876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1120/2239] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:12.296924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.303871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c32e-ac5c-486c-8fc9-a21a2baf55ab None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.307222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e88866-bc5d-40f1-b629-b9c3d94c3211 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.310991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.312203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.312732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.313189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.313343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.314201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.314619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.314751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:12.314949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.315444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.315941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.317943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.318133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.336520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1121/2240] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:12.337545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.347066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1120/2241] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:17:12.351559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.368974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdd2a9-fe23-48f9-83a2-0df46d2290b3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.377182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552812a-551e-46db-9daf-409549b6873a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.381345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f77bc-dc57-4856-b7e4-68cec4c7ad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.382296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f77bc-dc57-4856-b7e4-68cec4c7ad44 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.382745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f77bc-dc57-4856-b7e4-68cec4c7ad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.383300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f77bc-dc57-4856-b7e4-68cec4c7ad44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.384171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f77bc-dc57-4856-b7e4-68cec4c7ad44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.386933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f77bc-dc57-4856-b7e4-68cec4c7ad44 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.391422 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.392347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.392962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.393296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] PATH_INFO: `/v3/projects/4ce4b3ad274f4b6b9661a0c370d7c3e5/users/24f994b060594142a20dd48f8c575ca6/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.420368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce4b3ad274f4b6b9661a0c370d7c3e5, user_id=24f994b060594142a20dd48f8c575ca6, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.424176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.442108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1122/2242] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:12 2022] PUT /identity/v3/projects/4ce4b3ad274f4b6b9661a0c370d7c3e5/users/24f994b060594142a20dd48f8c575ca6/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:12.448706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1121/2243] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:12 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:12.464102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.464326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.464326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.464326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.504800 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] MFA Rules not processed for user `24f994b060594142a20dd48f8c575ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:12.505792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:12.635439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1122/2244] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:12.636867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5ea7-00a1-423d-b520-3df6a27d26f5 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.649213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.650791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:12.745199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.745855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.746126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.746401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.747040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.749607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.780671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1123/2245] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:12 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:12.784694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.796535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957886d-4cbe-4045-8b59-703ee2543da4 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.798814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93c339-42c5-43bc-84e9-d38738f2d57f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.802193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.803153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.803538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.803959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.804736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.805001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.805616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.805895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.806166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.806942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.824683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1124/2246] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:12.830979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.853675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:12.856637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.860518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.865549 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f46fc-f66a-4410-a7cc-220b64a0d3ca admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:12.884927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1123/2247] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:12.894696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa7f09-012d-4a8a-9d3e-6c73c0be9e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:12.895437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa7f09-012d-4a8a-9d3e-6c73c0be9e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:12.895781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa7f09-012d-4a8a-9d3e-6c73c0be9e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:12.896158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa7f09-012d-4a8a-9d3e-6c73c0be9e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:12.899059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa7f09-012d-4a8a-9d3e-6c73c0be9e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:12.908278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa7f09-012d-4a8a-9d3e-6c73c0be9e1d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:12.933657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1125/2248] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:12.939281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:12.968956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:12.992616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7158b-6b15-448d-b3e6-3a8089999e5e service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:13.015764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:13.016471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:13.016750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:13.017022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] PATH_INFO: `/v3/projects/e49ba29c576d4a40a591668c4c304aab/users/faff5534c95e49e18f14d69654fb4996/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:13.051770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49ba29c576d4a40a591668c4c304aab, user_id=faff5534c95e49e18f14d69654fb4996, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:13.063005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:13.097738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1124/2249] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:12 2022] PUT /identity/v3/projects/e49ba29c576d4a40a591668c4c304aab/users/faff5534c95e49e18f14d69654fb4996/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:13.110129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:13.110417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:13.110697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:13.160960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] MFA Rules not processed for user `faff5534c95e49e18f14d69654fb4996`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:13.163389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:13.262651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1126/2250] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:13.500263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:13.591249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a94b-a49b-4cfd-b5db-9bb8aed485a4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:13.597678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a0aca-502a-474b-a474-9d7c3a95c22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:13.598402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a0aca-502a-474b-a474-9d7c3a95c22d service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:13.599295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a0aca-502a-474b-a474-9d7c3a95c22d service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:13.599295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a0aca-502a-474b-a474-9d7c3a95c22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:13.610744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a0aca-502a-474b-a474-9d7c3a95c22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:13.612451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a0aca-502a-474b-a474-9d7c3a95c22d service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:13.626314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1125/2251] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:15.906781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:15.908273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:15.985389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb0178-1d59-41a3-92f7-450edd25d97e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:15.990174 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:15.990816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:15.991094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:15.991369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] PATH_INFO: `/v3/users/dd15b13137854780a1c36e33b45ffa61` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:15.992514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd15b13137854780a1c36e33b45ffa61)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:15.994446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:16.059072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd15b13137854780a1c36e33b45ffa61'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.059656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd15b13137854780a1c36e33b45ffa61'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.060327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd15b13137854780a1c36e33b45ffa61'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.076003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd15b13137854780a1c36e33b45ffa61'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.085320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd15b13137854780a1c36e33b45ffa61'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.105624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1127/2252] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:15 2022] DELETE /identity/v3/users/dd15b13137854780a1c36e33b45ffa61 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:16.111197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:16.111742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:16.111742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:16.152591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:16.160648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:16.286077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1126/2253] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:16.294379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:16.296102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:16.302270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:16.390312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8b5b-8d96-4d1b-b6ce-a1da096457c7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:16.394283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:16.395269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:16.395554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:16.395842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:16.408556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:16.410363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:16.428745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1128/2254] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:16.810237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:16.812560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:16.831790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6720ae3-57f7-4bd8-8c74-50ec87a3cdce None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:16.843141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:16.844415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:16.844415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:16.844415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] PATH_INFO: `/v3/projects/c9df4d17280145ab81d92a49fba86033` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:16.845662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9df4d17280145ab81d92a49fba86033)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:16.848112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:16.920741 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9df4d17280145ab81d92a49fba86033', 'request_id': 'req-9de52183-3bc0-419d-8dca-85ca54dff20e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.926681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9df4d17280145ab81d92a49fba86033', 'request_id': 'req-9de52183-3bc0-419d-8dca-85ca54dff20e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.937838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9df4d17280145ab81d92a49fba86033', 'request_id': 'req-9de52183-3bc0-419d-8dca-85ca54dff20e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.950546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] The token cache is being invalidate because project c9df4d17280145ab81d92a49fba86033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:16.951507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.952287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:16.954192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1127/2255] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:16 2022] DELETE /identity/v3/projects/c9df4d17280145ab81d92a49fba86033 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:16.957978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:16.969898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57b03-3ff2-4e9f-8065-412931d1db50 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:17.045443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:17.046596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.047067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.047571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] PATH_INFO: `/v3/users/e7c27ea2a2a84703ae7ae0c718ec039e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.048886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c27ea2a2a84703ae7ae0c718ec039e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:17.050983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:17.115209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c27ea2a2a84703ae7ae0c718ec039e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.117385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c27ea2a2a84703ae7ae0c718ec039e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.117945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c27ea2a2a84703ae7ae0c718ec039e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.135636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c27ea2a2a84703ae7ae0c718ec039e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.144028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b60077a-e419-4f53-9a49-0474148c8a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c27ea2a2a84703ae7ae0c718ec039e'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.163026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1129/2256] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:16 2022] DELETE /identity/v3/users/e7c27ea2a2a84703ae7ae0c718ec039e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:17.532874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:17.534655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:17.549204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:17.553372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de52183-3bc0-419d-8dca-85ca54dff20e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:17.643867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:17.644444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.644717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.644995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] PATH_INFO: `/v3/projects/047238d156824568b5eb13a0f5b796b5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.646139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=047238d156824568b5eb13a0f5b796b5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:17.648103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:17.702638 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '047238d156824568b5eb13a0f5b796b5', 'request_id': 'req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.709048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '047238d156824568b5eb13a0f5b796b5', 'request_id': 'req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.720203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '047238d156824568b5eb13a0f5b796b5', 'request_id': 'req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.732508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] The token cache is being invalidate because project 047238d156824568b5eb13a0f5b796b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:17.732901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.733600 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-76a1b8d8-ebf9-44c1-9494-dd62eaac5f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:17.735128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1128/2257] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:17 2022] DELETE /identity/v3/projects/047238d156824568b5eb13a0f5b796b5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:17.740234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467eb6be-0a7a-43e6-b8da-1c38fcf4caf9 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.740621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467eb6be-0a7a-43e6-b8da-1c38fcf4caf9 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.741000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467eb6be-0a7a-43e6-b8da-1c38fcf4caf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.768446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-467eb6be-0a7a-43e6-b8da-1c38fcf4caf9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:17.769767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-467eb6be-0a7a-43e6-b8da-1c38fcf4caf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:17.793515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:17.844489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1130/2258] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:17.853181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c7458-3524-482c-8898-6913f64be417 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.853482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c7458-3524-482c-8898-6913f64be417 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.853747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c7458-3524-482c-8898-6913f64be417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.880986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3a0c7458-3524-482c-8898-6913f64be417 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:17.882241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3a0c7458-3524-482c-8898-6913f64be417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:17.894985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1129/2259] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:17.899428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467eb6be-0a7a-43e6-b8da-1c38fcf4caf9 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:17.916640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467eb6be-0a7a-43e6-b8da-1c38fcf4caf9 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:17.924499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:17.925919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.926364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.926813 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.927665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:17.928143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:17.930697 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:17.952213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1131/2260] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:17.956806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c7458-3524-482c-8898-6913f64be417 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:17.969798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c7458-3524-482c-8898-6913f64be417 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:17.978378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:17.979007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:17.979427 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:17.979533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:17.980226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:17.982718 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.017189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1130/2261] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:17 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:18.021053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:18.034348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463457-3355-43e7-af55-df50607816ab admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:18.104119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:18.104750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.105031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.105305 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.105944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:18.108068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.133144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1132/2262] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:18 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:18.137484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:18.150650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c1d0-a421-440c-a6ca-5b2462cc351b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:18.159459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:18.160133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.160459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.160737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.161389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:18.162978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.174722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1131/2263] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:18.178356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:18.191204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3daaf-4f11-4506-877b-cb03ce1856da admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:18.198555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64be12-5171-45a7-8b47-db4b6e4eac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:18.199492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64be12-5171-45a7-8b47-db4b6e4eac0c admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.200038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64be12-5171-45a7-8b47-db4b6e4eac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.200496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64be12-5171-45a7-8b47-db4b6e4eac0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.201719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64be12-5171-45a7-8b47-db4b6e4eac0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:18.203325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64be12-5171-45a7-8b47-db4b6e4eac0c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.219890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1133/2264] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:18.221060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:18.232431 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc1e0-6c79-4ec0-888b-76e402c0656c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:18.240463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:18.241240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.241533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.241814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] PATH_INFO: `/v3/projects/b5ed8669774c4415a3bff2b669d5e7a6/users/f10d2913ff114f718674c9a1fd41db23/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.260544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ed8669774c4415a3bff2b669d5e7a6, user_id=f10d2913ff114f718674c9a1fd41db23, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:18.262252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.291546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1132/2265] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:18 2022] PUT /identity/v3/projects/b5ed8669774c4415a3bff2b669d5e7a6/users/f10d2913ff114f718674c9a1fd41db23/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:18.293406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caf6ab-d4ba-4952-a0f8-fff54872ad4d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.293758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caf6ab-d4ba-4952-a0f8-fff54872ad4d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.294098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caf6ab-d4ba-4952-a0f8-fff54872ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.337005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-21caf6ab-d4ba-4952-a0f8-fff54872ad4d None None] MFA Rules not processed for user `f10d2913ff114f718674c9a1fd41db23`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:18.338402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-21caf6ab-d4ba-4952-a0f8-fff54872ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:18.490890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:18.493276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1134/2266] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:18.568968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a482e2-9454-45be-93ec-733dcb429c9d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.569278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a482e2-9454-45be-93ec-733dcb429c9d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.569559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a482e2-9454-45be-93ec-733dcb429c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.584972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:18.602339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-44a482e2-9454-45be-93ec-733dcb429c9d None None] MFA Rules not processed for user `faff5534c95e49e18f14d69654fb4996`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:18.603704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-44a482e2-9454-45be-93ec-733dcb429c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:18.635302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:18.636568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043782-af98-46b6-8570-1cf58507768a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:18.642682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:18.643615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.644503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.645001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.646363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:18.648714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.711608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1133/2267] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:18 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:18.713330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:18.745808 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1135/2268] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:18.883144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a61c-9d07-4dcc-a177-911f7fb7fbe3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:18.897353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:18.898077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:18.898369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:18.898671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:18.899291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:18.901336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:18.952495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1134/2269] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:18 2022] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:18.953758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a482e2-9454-45be-93ec-733dcb429c9d None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:18.989881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a482e2-9454-45be-93ec-733dcb429c9d None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.013351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.016416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.018784 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.019725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.021236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.026327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.067720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1136/2270] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:19.072600 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:19.092902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6385-81e6-4e40-827c-6223c6f458f7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.106689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.111001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.111001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.112010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:19.112229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] PATH_INFO: `/v3/projects/57a56ee4a96d4623b20e6fdb3f144557/users/5e41adc7fc6f49a69a851ae5204957b0/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.113933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.140324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a56ee4a96d4623b20e6fdb3f144557, user_id=5e41adc7fc6f49a69a851ae5204957b0, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.143083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34a849-2ac6-4009-9382-39527b3693a9 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.145580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.155321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.156072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.156465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.156781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] PATH_INFO: `/v3/users/6f7813698a58481c8f630636ff16721f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.158396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7813698a58481c8f630636ff16721f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.163177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.176338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1135/2271] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:19 2022] PUT /identity/v3/projects/57a56ee4a96d4623b20e6fdb3f144557/users/5e41adc7fc6f49a69a851ae5204957b0/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:19.181954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:19.288097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7813698a58481c8f630636ff16721f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:19.289150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7813698a58481c8f630636ff16721f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:19.290930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7813698a58481c8f630636ff16721f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:19.309336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7813698a58481c8f630636ff16721f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:19.333228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dda48-d026-43e2-acde-fd37a45415ea admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.341740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7ac99960-c551-4d16-aece-b0814e2c0b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7813698a58481c8f630636ff16721f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:19.348027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.348705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.348990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.349266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.350704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.365409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.366656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1137/2272] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:19 2022] DELETE /identity/v3/users/6f7813698a58481c8f630636ff16721f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:19.370756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.371163 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.371546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.378895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1136/2273] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:19.382976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:19.387687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.402775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ab134-c8c0-4ff3-86da-d94483ee8288 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.422892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:19.423076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:19.429128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.525485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52bc08-f95c-4ab3-bba4-31710acb0147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.526576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52bc08-f95c-4ab3-bba4-31710acb0147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.526989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52bc08-f95c-4ab3-bba4-31710acb0147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.527371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52bc08-f95c-4ab3-bba4-31710acb0147 admin admin] PATH_INFO: `/v3/projects/57a56ee4a96d4623b20e6fdb3f144557/users/5e41adc7fc6f49a69a851ae5204957b0/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.559016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1138/2274] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:19.569063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:19.570638 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.571262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52bc08-f95c-4ab3-bba4-31710acb0147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a56ee4a96d4623b20e6fdb3f144557, user_id=5e41adc7fc6f49a69a851ae5204957b0, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.574038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52bc08-f95c-4ab3-bba4-31710acb0147 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.606577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1137/2275] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:19 2022] PUT /identity/v3/projects/57a56ee4a96d4623b20e6fdb3f144557/users/5e41adc7fc6f49a69a851ae5204957b0/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:19.618865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.619305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.619591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.661926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:19.664003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] MFA Rules not processed for user `5e41adc7fc6f49a69a851ae5204957b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:19.666070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.720938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f01a-5c26-4a2d-a5e2-46658591640f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.765332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1138/2276] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:19.777018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:19.778501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:19.818489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.820408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.820692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.821284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.863185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e2443-e675-4f74-9e17-ae21d8b1a0c0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:19.870333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:19.872178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:19.877730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:19.878246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:19.901046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.903921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.920631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1139/2277] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:19.962501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:19.964099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:19.984919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1139/2278] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:20.227635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:20.256943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:20.302650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9217-0809-4eb7-9457-909d6bd80ad0 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:20.383894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:20.384579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:20.384877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:20.385153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:20.396978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:20.489819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:20.526318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:20.528221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:20.541433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1140/2279] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:20.928120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:20.929786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:20.949507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd638d8-04ca-42d3-8cc7-ae49d9d73cd5 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:20.955050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:20.956402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:20.956402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:20.956853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] PATH_INFO: `/v3/projects/99811b4cb3fb4931958d0a360aba306b` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:20.957827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99811b4cb3fb4931958d0a360aba306b)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:20.959740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:21.059323 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99811b4cb3fb4931958d0a360aba306b', 'request_id': 'req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.068115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99811b4cb3fb4931958d0a360aba306b', 'request_id': 'req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.083625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99811b4cb3fb4931958d0a360aba306b', 'request_id': 'req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.103377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] The token cache is being invalidate because project 99811b4cb3fb4931958d0a360aba306b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:21.103965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.105017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e9630c8f-3e8c-44ef-a432-58ca94ba5c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.112654 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:21.120616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1140/2280] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:20 2022] DELETE /identity/v3/projects/99811b4cb3fb4931958d0a360aba306b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:21.129468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e90b1-6fe1-4538-bec3-1fbc958cc456 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:21.229207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:21.230671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:21.231062 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:21.231558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] PATH_INFO: `/v3/users/1379d921b9a744be8b873abe9258fa30` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:21.233295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1379d921b9a744be8b873abe9258fa30)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:21.235723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:21.322792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1379d921b9a744be8b873abe9258fa30'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.363595 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1379d921b9a744be8b873abe9258fa30'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.364821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1379d921b9a744be8b873abe9258fa30'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.385898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1379d921b9a744be8b873abe9258fa30'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.397243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1379d921b9a744be8b873abe9258fa30'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:21.406097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1141/2281] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:21 2022] DELETE /identity/v3/users/1379d921b9a744be8b873abe9258fa30 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:21.783952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f246-1271-4516-bc77-3fd607c8e981 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:21.784482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f246-1271-4516-bc77-3fd607c8e981 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:21.785132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f246-1271-4516-bc77-3fd607c8e981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:21.810494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ac15f246-1271-4516-bc77-3fd607c8e981 None None] MFA Rules not processed for user `388379cb8722477fbba3162dcbe3cc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:21.811894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ac15f246-1271-4516-bc77-3fd607c8e981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:21.822848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:21.922873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1141/2282] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:21.959754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:21.961667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:22.071496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:22.078464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f30f-2eba-47d0-ace4-ac7222aee326 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.087363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.089066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.089066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.089343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] PATH_INFO: `/v3/projects/157dd1ff3e5f4c539a42b2a856138a09` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.092742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157dd1ff3e5f4c539a42b2a856138a09)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.099216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.210763 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157dd1ff3e5f4c539a42b2a856138a09', 'request_id': 'req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:22.211680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157dd1ff3e5f4c539a42b2a856138a09', 'request_id': 'req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:22.225616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157dd1ff3e5f4c539a42b2a856138a09', 'request_id': 'req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:22.240059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] The token cache is being invalidate because project 157dd1ff3e5f4c539a42b2a856138a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:22.240674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:22.241329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3f78d7a3-5b2f-4103-9d97-5959cdb72e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:22.243298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1142/2283] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:21 2022] DELETE /identity/v3/projects/157dd1ff3e5f4c539a42b2a856138a09 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:22.249337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb476-98f9-47ff-abe0-11d834e53832 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.249847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb476-98f9-47ff-abe0-11d834e53832 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.249847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb476-98f9-47ff-abe0-11d834e53832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.280740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-816eb476-98f9-47ff-abe0-11d834e53832 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:22.281970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-816eb476-98f9-47ff-abe0-11d834e53832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:22.362968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1142/2284] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:22.374939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db9c2-c674-404f-86c5-b29e0a66b1af None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.376139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db9c2-c674-404f-86c5-b29e0a66b1af None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.376593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901db9c2-c674-404f-86c5-b29e0a66b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.403567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-901db9c2-c674-404f-86c5-b29e0a66b1af None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:22.405368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-901db9c2-c674-404f-86c5-b29e0a66b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:22.416432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1143/2285] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:22.422224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eb476-98f9-47ff-abe0-11d834e53832 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:22.438388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eb476-98f9-47ff-abe0-11d834e53832 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.443240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.443980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.444408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.444514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.445183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:22.445489 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.447148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.460986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1143/2286] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:17:22.467859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db9c2-c674-404f-86c5-b29e0a66b1af None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:22.479086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901db9c2-c674-404f-86c5-b29e0a66b1af None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.485185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.485811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.486091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.486360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.487002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.489002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.522529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1144/2287] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:22 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:22.523654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:22.535499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b860d9f-c9b9-48a5-9308-04337aec4b99 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.595319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.595976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.596586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.596586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.597145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.599072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.625915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1144/2288] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:22 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:22.627406 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:22.639345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451b988-1b2f-4bc7-885a-76565a676906 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.644643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.645262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.645551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.646345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.646487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.648093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.685051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1145/2289] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:22.690843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:22.706403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc9b4-e7ed-4995-89e9-d9facef01c08 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.714136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85772d-af0e-42a2-a829-e45f3d03a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.714844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85772d-af0e-42a2-a829-e45f3d03a9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.715146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85772d-af0e-42a2-a829-e45f3d03a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.715416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85772d-af0e-42a2-a829-e45f3d03a9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.716761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85772d-af0e-42a2-a829-e45f3d03a9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.718636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85772d-af0e-42a2-a829-e45f3d03a9e9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.734810 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1145/2290] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:22.739706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:22.756145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b03b1-868c-48b3-8f81-5d1ee2dbda33 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:22.771327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:22.772409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.772724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.773076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] PATH_INFO: `/v3/projects/e87e274a10e94a62b9aedc80da9ba3a1/users/6aff6b9a8d264a67916948858a705f79/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.794906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87e274a10e94a62b9aedc80da9ba3a1, user_id=6aff6b9a8d264a67916948858a705f79, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:22.798175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:22.816000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1146/2291] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:22 2022] PUT /identity/v3/projects/e87e274a10e94a62b9aedc80da9ba3a1/users/6aff6b9a8d264a67916948858a705f79/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:22.829773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:22.830097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:22.830441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:22.911389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] MFA Rules not processed for user `6aff6b9a8d264a67916948858a705f79`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:22.912667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:22.936930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:23.012519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1146/2292] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:23.034872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:23.036546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:23.145719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575a644-33b1-4d5a-85b8-dab0575ed1d1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:23.155055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d75635-e2ce-4ed0-b371-481011e137e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:23.156670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75635-e2ce-4ed0-b371-481011e137e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:23.157316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75635-e2ce-4ed0-b371-481011e137e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:23.157853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d75635-e2ce-4ed0-b371-481011e137e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:23.170927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d75635-e2ce-4ed0-b371-481011e137e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:23.173017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d75635-e2ce-4ed0-b371-481011e137e7 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:23.193843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1147/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:23.509348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:23.511268 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:23.666311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31579ffa-9b42-4903-b402-60de470d1645 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:23.672917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:23.673412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:23.673616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:23.673832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] PATH_INFO: `/v3/users/f10d2913ff114f718674c9a1fd41db23` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:23.675367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10d2913ff114f718674c9a1fd41db23)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:23.677322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:23.743874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10d2913ff114f718674c9a1fd41db23'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:23.744588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10d2913ff114f718674c9a1fd41db23'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:23.745487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10d2913ff114f718674c9a1fd41db23'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:23.760745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10d2913ff114f718674c9a1fd41db23'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:23.770230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10d2913ff114f718674c9a1fd41db23'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:23.785773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1147/2294] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:23 2022] DELETE /identity/v3/users/f10d2913ff114f718674c9a1fd41db23 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:23.790450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:23.790985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:23.790985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:23.812357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:23.813868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:23.842878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:23.892555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1148/2295] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:23.901911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:23.903343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:23.932200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:23.933994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:23.947960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504cbb9-dafd-4ec9-96ab-a36d45f0e97c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:23.958158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:23.958813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:23.959151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:23.959430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] PATH_INFO: `/v3/users/4bed309603e045e6ac3c39d0a7cece3c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:23.961584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bed309603e045e6ac3c39d0a7cece3c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:23.961869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:23.964981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:23.984339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4027600-78e9-4695-91ba-d51341c2b0f7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:23.990191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae740b7-b16f-4a2f-808a-c293d35e811b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:23.990191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae740b7-b16f-4a2f-808a-c293d35e811b service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:23.990395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae740b7-b16f-4a2f-808a-c293d35e811b service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:23.991107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae740b7-b16f-4a2f-808a-c293d35e811b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:24.004381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae740b7-b16f-4a2f-808a-c293d35e811b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:24.005838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae740b7-b16f-4a2f-808a-c293d35e811b service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:24.016766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1148/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:24.026818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bed309603e045e6ac3c39d0a7cece3c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.035867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bed309603e045e6ac3c39d0a7cece3c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.036711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bed309603e045e6ac3c39d0a7cece3c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.054749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bed309603e045e6ac3c39d0a7cece3c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.066407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bed309603e045e6ac3c39d0a7cece3c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.078363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1149/2297] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:23 2022] DELETE /identity/v3/users/4bed309603e045e6ac3c39d0a7cece3c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:24.083947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:24.084435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:24.084977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:24.121005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:24.125626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:24.236806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1149/2298] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:24.257447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:24.259163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:24.367847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70833-1960-4b40-bcb8-ee929463c416 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:24.376927 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:24.379779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:24.380399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:24.380833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:24.410660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:24.412266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:24.432215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1150/2299] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:24.438044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:24.439457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:24.452346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6f86-9790-4cc7-9ddf-8229c9540b4f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:24.457300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:24.457920 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:24.458234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:24.458481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] PATH_INFO: `/v3/projects/b5ed8669774c4415a3bff2b669d5e7a6` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:24.461327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ed8669774c4415a3bff2b669d5e7a6)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:24.463578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:24.556332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ed8669774c4415a3bff2b669d5e7a6', 'request_id': 'req-d467d7c7-ff92-4ec6-9a7e-182223bfe354'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.575030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ed8669774c4415a3bff2b669d5e7a6', 'request_id': 'req-d467d7c7-ff92-4ec6-9a7e-182223bfe354'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.593375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ed8669774c4415a3bff2b669d5e7a6', 'request_id': 'req-d467d7c7-ff92-4ec6-9a7e-182223bfe354'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.617662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] The token cache is being invalidate because project b5ed8669774c4415a3bff2b669d5e7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:24.618002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.618899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.625115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1150/2300] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:24 2022] DELETE /identity/v3/projects/b5ed8669774c4415a3bff2b669d5e7a6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:24.633232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:24.646908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ead19c-6291-4449-8ad3-85ee7d596349 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:24.732736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:24.756166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:24.756692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:24.757075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:24.757491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] PATH_INFO: `/v3/users/5e41adc7fc6f49a69a851ae5204957b0` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:24.758811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e41adc7fc6f49a69a851ae5204957b0)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:24.762244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:24.850846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e41adc7fc6f49a69a851ae5204957b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.862710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e41adc7fc6f49a69a851ae5204957b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.863676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e41adc7fc6f49a69a851ae5204957b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.907665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e41adc7fc6f49a69a851ae5204957b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.925757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e619880-3bc2-43b3-97d1-444cdf7dd40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e41adc7fc6f49a69a851ae5204957b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:24.939133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1151/2301] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:24 2022] DELETE /identity/v3/users/5e41adc7fc6f49a69a851ae5204957b0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:25.013964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.015973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.061239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467d7c7-ff92-4ec6-9a7e-182223bfe354 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.203921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.204727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.205081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.205425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] PATH_INFO: `/v3/projects/30ba67b459ea4a58aa4e177158ec78c7` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.206639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ba67b459ea4a58aa4e177158ec78c7)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.208839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.211720 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:25.271327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ba67b459ea4a58aa4e177158ec78c7', 'request_id': 'req-9b542565-99c9-4089-9579-907afe400a21'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.278309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ba67b459ea4a58aa4e177158ec78c7', 'request_id': 'req-9b542565-99c9-4089-9579-907afe400a21'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.286443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ba67b459ea4a58aa4e177158ec78c7', 'request_id': 'req-9b542565-99c9-4089-9579-907afe400a21'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.300294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] The token cache is being invalidate because project 30ba67b459ea4a58aa4e177158ec78c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:25.300629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.302347 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.304548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1151/2302] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:25 2022] DELETE /identity/v3/projects/30ba67b459ea4a58aa4e177158ec78c7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:25.309429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21645ab-6f32-4091-a8e1-c1318c33f41a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.310555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21645ab-6f32-4091-a8e1-c1318c33f41a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.311222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21645ab-6f32-4091-a8e1-c1318c33f41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.333059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.334548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.355961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d21645ab-6f32-4091-a8e1-c1318c33f41a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:25.356770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d21645ab-6f32-4091-a8e1-c1318c33f41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.454320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1152/2303] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:25.462197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd230d-d887-49a3-87ac-22b1471bf4c1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.462481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd230d-d887-49a3-87ac-22b1471bf4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.462750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd230d-d887-49a3-87ac-22b1471bf4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.493967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5bdd230d-d887-49a3-87ac-22b1471bf4c1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:25.496987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b542565-99c9-4089-9579-907afe400a21 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.497380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5bdd230d-d887-49a3-87ac-22b1471bf4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.505238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.505979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.506331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.506778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] PATH_INFO: `/v3/projects/57a56ee4a96d4623b20e6fdb3f144557` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.507042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1153/2304] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:25.508081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a56ee4a96d4623b20e6fdb3f144557)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.510426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.511308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd230d-d887-49a3-87ac-22b1471bf4c1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.522736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd230d-d887-49a3-87ac-22b1471bf4c1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.528074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.529272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.529557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.529834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.530499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:25.530851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.533084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.545444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1154/2305] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:17:25.550576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.562798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1aaf0-b0a0-4923-9289-92197bc2634c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.569946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a56ee4a96d4623b20e6fdb3f144557', 'request_id': 'req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.576069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a56ee4a96d4623b20e6fdb3f144557', 'request_id': 'req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.584833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a56ee4a96d4623b20e6fdb3f144557', 'request_id': 'req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.596742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] The token cache is being invalidate because project 57a56ee4a96d4623b20e6fdb3f144557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:25.597038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.597692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fc45574b-bc48-42d3-8213-0fb6b8e7cb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.599215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1152/2306] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:25 2022] DELETE /identity/v3/projects/57a56ee4a96d4623b20e6fdb3f144557 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:25.604836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b4b0-bbea-4b9d-b7b3-aca22f014bfe None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.605280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b4b0-bbea-4b9d-b7b3-aca22f014bfe None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.605661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b4b0-bbea-4b9d-b7b3-aca22f014bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.609177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:25.627932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.628162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b572b4b0-bbea-4b9d-b7b3-aca22f014bfe None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:25.628707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.628985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.629258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.629348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b572b4b0-bbea-4b9d-b7b3-aca22f014bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.629888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.631822 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.637962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1153/2307] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:25.645975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.646265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.646539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.665167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1155/2308] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:25.668523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:25.668783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.671012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.671187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.682507 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:25.738275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1154/2309] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:25.739170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.741704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715550-3ea0-4677-b869-5e949a3f2d9c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.742486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.747678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.748184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.748468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.748761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] PATH_INFO: `/v3/users/24f994b060594142a20dd48f8c575ca6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.749908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f994b060594142a20dd48f8c575ca6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.751868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.755049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8a0cb-936c-4b49-a940-707f82907829 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.760256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.760862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.761169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.761442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.762067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.764771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.788161 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1155/2310] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:25.788963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.799894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90425-7c2c-4fed-8dd9-b80365f309f2 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.805191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.805805 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.806766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.806766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.807050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:25.807301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.808160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f994b060594142a20dd48f8c575ca6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.808970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.818199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f994b060594142a20dd48f8c575ca6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.818901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f994b060594142a20dd48f8c575ca6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.824149 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1156/2311] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:25.829172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.838873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f994b060594142a20dd48f8c575ca6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.839547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbac499-e930-41dc-b5bc-8d3c3f6a8821 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.845111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62b2d5-dda0-4a6f-9b8a-1fe575e18e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.845735 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62b2d5-dda0-4a6f-9b8a-1fe575e18e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.846131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62b2d5-dda0-4a6f-9b8a-1fe575e18e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.846334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62b2d5-dda0-4a6f-9b8a-1fe575e18e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.847220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62b2d5-dda0-4a6f-9b8a-1fe575e18e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.849164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62b2d5-dda0-4a6f-9b8a-1fe575e18e5f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.850254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f994b060594142a20dd48f8c575ca6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:25.857264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1156/2312] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:25 2022] DELETE /identity/v3/users/24f994b060594142a20dd48f8c575ca6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:25.861572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1157/2313] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:25.861789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.863040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.863157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.863338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.863601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.886524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:25.887737 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.929202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:25.947459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f683c61-4b55-40aa-bf28-e568f58365f6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.952370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.952984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.953265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.953540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.954191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.954693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1158/2314] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:25.955545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.956149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.957052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.969655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766319a-232f-4c86-b90e-d8be913200ac None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:25.975199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:25.975900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:25.976211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:25.976490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:25.977247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:25.978878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:25.984139 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1157/2315] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:25.984972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:25.986565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:25.989994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1159/2316] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:25.990794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.004227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec894215-e35c-4319-8af4-b2bdf6f969fb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.046317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e90507-58c0-4a1e-8938-182447cf8e34 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.050137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.050738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.051016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.051290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.062077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.062694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.062980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.063253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.063916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.065953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.076814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:26.092339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1160/2317] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:25 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:26.093134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.103192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7279da1-03ef-4311-84b6-910018241cf7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.107973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc245d84-c677-43fa-ab72-d9e3c0724087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.108613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245d84-c677-43fa-ab72-d9e3c0724087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.108901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245d84-c677-43fa-ab72-d9e3c0724087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.109176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245d84-c677-43fa-ab72-d9e3c0724087 admin admin] PATH_INFO: `/v3/projects/4c7ec8036f064f40b8a89d6b2e1b1b21/users/a4b40b399d0c49b7be4f13c3a3c72eeb/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.120511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.121968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.124104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc245d84-c677-43fa-ab72-d9e3c0724087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7ec8036f064f40b8a89d6b2e1b1b21, user_id=a4b40b399d0c49b7be4f13c3a3c72eeb, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.126773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc245d84-c677-43fa-ab72-d9e3c0724087 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.132328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1158/2318] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:26.133102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.142829 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1161/2319] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:26 2022] PUT /identity/v3/projects/4c7ec8036f064f40b8a89d6b2e1b1b21/users/a4b40b399d0c49b7be4f13c3a3c72eeb/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:26.143324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edb273-8e9e-461d-ab23-efe7e54b60d8 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.152885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6723c5-8317-4141-90ae-5119ea835bfb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.153175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6723c5-8317-4141-90ae-5119ea835bfb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.153460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6723c5-8317-4141-90ae-5119ea835bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.191960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2b6723c5-8317-4141-90ae-5119ea835bfb None None] MFA Rules not processed for user `a4b40b399d0c49b7be4f13c3a3c72eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:26.193953 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2b6723c5-8317-4141-90ae-5119ea835bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.227115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.228242 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.228596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.228935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.229986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.232292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.248693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1159/2320] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:26.249688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.259377 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5d3b1-87f5-43d4-b2f8-aba483a8b069 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.264747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.265346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.265624 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.266199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.267326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.269060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.273237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1162/2321] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:26.282895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1160/2322] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:26.289619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.291386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.292636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6723c5-8317-4141-90ae-5119ea835bfb None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.302551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:26.304519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6723c5-8317-4141-90ae-5119ea835bfb None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.311296 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df058827-de73-47f9-b64d-0cf6f080f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.312159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df058827-de73-47f9-b64d-0cf6f080f602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.312510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df058827-de73-47f9-b64d-0cf6f080f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.313333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df058827-de73-47f9-b64d-0cf6f080f602 admin admin] PATH_INFO: `/v3/projects/34833bafae3f4233bd9a4c104bc3140f/users/3ebf7cc4153d4dbe857dce5edda74afc/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.330931 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df058827-de73-47f9-b64d-0cf6f080f602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34833bafae3f4233bd9a4c104bc3140f, user_id=3ebf7cc4153d4dbe857dce5edda74afc, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.334590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df058827-de73-47f9-b64d-0cf6f080f602 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.352753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1163/2323] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:26 2022] PUT /identity/v3/projects/34833bafae3f4233bd9a4c104bc3140f/users/3ebf7cc4153d4dbe857dce5edda74afc/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:26.360830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37423b78-f027-46fe-99c3-4ee121ece3cd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.365204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.366329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.366873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.404342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] MFA Rules not processed for user `3ebf7cc4153d4dbe857dce5edda74afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:26.405812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.426601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.427313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.427701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.428064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.486439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1164/2324] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:26.489247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.490929 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.497201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.499093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.508740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1161/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:26.509969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.537730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:26.600682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dba3-0cb0-4e68-97f5-2fdf3e95c01a service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.609961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.610728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.611015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.611692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.612393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.614607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.617952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7623-27fe-4eaa-b265-12c64195d71e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.627781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.629401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.629915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.630422 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] PATH_INFO: `/v3/projects/4ce4b3ad274f4b6b9661a0c370d7c3e5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.632739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce4b3ad274f4b6b9661a0c370d7c3e5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.635989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.669998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1162/2326] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/projects => generated 409 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:26.671311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.679245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:26.721455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce4b3ad274f4b6b9661a0c370d7c3e5', 'request_id': 'req-ccde3d37-ae39-4f7e-b3df-5e42421659fe'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:26.731664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce4b3ad274f4b6b9661a0c370d7c3e5', 'request_id': 'req-ccde3d37-ae39-4f7e-b3df-5e42421659fe'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:26.740496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce4b3ad274f4b6b9661a0c370d7c3e5', 'request_id': 'req-ccde3d37-ae39-4f7e-b3df-5e42421659fe'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:26.752463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] The token cache is being invalidate because project 4ce4b3ad274f4b6b9661a0c370d7c3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:26.752755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:26.753396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ccde3d37-ae39-4f7e-b3df-5e42421659fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:26.758883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1165/2327] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:26 2022] DELETE /identity/v3/projects/4ce4b3ad274f4b6b9661a0c370d7c3e5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:26.759037 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bbba2-06ce-49f3-81fc-b6879d8fd2f1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.760277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3997c55-cb0f-4304-a4ec-2ddf35e2144b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.760597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3997c55-cb0f-4304-a4ec-2ddf35e2144b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.760867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3997c55-cb0f-4304-a4ec-2ddf35e2144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.786225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e3997c55-cb0f-4304-a4ec-2ddf35e2144b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:26.787526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e3997c55-cb0f-4304-a4ec-2ddf35e2144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.835019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.836012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.836644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.837136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.841745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.844001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.872096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1163/2328] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:26.876193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.878959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.884664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1166/2329] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:26.894963 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5449a0-c959-4ee5-b1b4-af3f22f6c790 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.895248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5449a0-c959-4ee5-b1b4-af3f22f6c790 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.895518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5449a0-c959-4ee5-b1b4-af3f22f6c790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.910578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c93e0-b1cb-4e12-bfb4-882bbda454d0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.922797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-dc5449a0-c959-4ee5-b1b4-af3f22f6c790 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:26.924046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dc5449a0-c959-4ee5-b1b4-af3f22f6c790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.925177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.932670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.933147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.933783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.934683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.939550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1167/2330] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:26.939550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5449a0-c959-4ee5-b1b4-af3f22f6c790 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.942308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.949294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5449a0-c959-4ee5-b1b4-af3f22f6c790 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.959851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1164/2331] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:26.962131 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:26.964511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.966827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.966827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.966827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.967076 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:26.967730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:26.970091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:26.976192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165ee09-9ede-430e-98e5-dfc6e3f7d0a7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:26.982869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:26.983571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.983883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.984162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] PATH_INFO: `/v3/projects/9509307a3c9c4d02b558fa06cab666af/users/b140b001a0f24e0ea5277a1ea1a3043f/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.988536 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1168/2332] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:26.992622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.003574 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540013-6850-427c-8d99-acf104b1e7cd admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.005169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9509307a3c9c4d02b558fa06cab666af, user_id=b140b001a0f24e0ea5277a1ea1a3043f, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.008279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.009007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.010007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.010523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.010938 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.011760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.013840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.025329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1165/2333] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:26 2022] PUT /identity/v3/projects/9509307a3c9c4d02b558fa06cab666af/users/b140b001a0f24e0ea5277a1ea1a3043f/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:27.031613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.050130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1169/2334] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:27.051775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.067273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:27.112916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c614-026e-48e6-9a8b-d9f66035c2c4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.122511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:27.130078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342a3b5-1ad3-44e6-a089-cdf43d1019f9 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.135023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.135686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.135982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.136257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.136886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.138918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.160563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1170/2335] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:27 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:27.164491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.175186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.175460 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29de37-7bfd-4535-b6e5-16eea2c7ce3a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.175796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.176101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.176366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.177003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.178581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.180067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.180657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.181067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.181344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.182013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.183656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.189968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1166/2336] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:27.193940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.194569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1171/2337] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:27.200732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.206360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a102c8e-cc0c-4055-b0e3-ae7bd4012ce2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.211667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e052d-bae9-43db-85d4-e70791df8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.212393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e052d-bae9-43db-85d4-e70791df8926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.212798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e052d-bae9-43db-85d4-e70791df8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.213081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e052d-bae9-43db-85d4-e70791df8926 admin admin] PATH_INFO: `/v3/projects/9509307a3c9c4d02b558fa06cab666af/users/b140b001a0f24e0ea5277a1ea1a3043f/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.213331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac434964-6d51-4baf-b421-fdd6cc28c57a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.214968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e052d-bae9-43db-85d4-e70791df8926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9509307a3c9c4d02b558fa06cab666af, user_id=b140b001a0f24e0ea5277a1ea1a3043f, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.218410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e052d-bae9-43db-85d4-e70791df8926 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.219359 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.220182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.220369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.220538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.221158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.222758 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.229477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1167/2338] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:27 2022] PUT /identity/v3/projects/9509307a3c9c4d02b558fa06cab666af/users/b140b001a0f24e0ea5277a1ea1a3043f/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:27.237474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1172/2339] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:27.239639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eede148-833a-49e6-bb11-d10efd15b0aa None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.239967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eede148-833a-49e6-bb11-d10efd15b0aa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.240249 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eede148-833a-49e6-bb11-d10efd15b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.241382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.251912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff7f0d-7045-4d5a-99ad-942d88437dab admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.269048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9eede148-833a-49e6-bb11-d10efd15b0aa None None] MFA Rules not processed for user `b140b001a0f24e0ea5277a1ea1a3043f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:27.270275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9eede148-833a-49e6-bb11-d10efd15b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.310835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.311664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.312346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.312346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] PATH_INFO: `/v3/projects/f56d1e6c388241898d0ff48929ce0d9a/users/9e964d23f9b041a5a63735c2c78d8ae6/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.328186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56d1e6c388241898d0ff48929ce0d9a, user_id=9e964d23f9b041a5a63735c2c78d8ae6, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.330828 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.343375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1168/2340] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:27.350424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1173/2341] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:27 2022] PUT /identity/v3/projects/f56d1e6c388241898d0ff48929ce0d9a/users/9e964d23f9b041a5a63735c2c78d8ae6/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:27.352361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.352651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.352941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.354316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.356096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.373797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:27.374994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.414257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb77e0-c6a2-46a5-ad98-0f8958b71d9e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.417995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.418602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.418887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.419159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.437764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:27.438912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1169/2342] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:27.449376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.450893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.473725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:27.485435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.486937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.496686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1174/2343] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:27.517889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a5017-1e83-45ab-8d3e-0c6597101ab5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.521473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20700826-842c-4d76-9c7c-65bf64296d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.522080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20700826-842c-4d76-9c7c-65bf64296d94 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.522358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20700826-842c-4d76-9c7c-65bf64296d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.522634 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20700826-842c-4d76-9c7c-65bf64296d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.534209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20700826-842c-4d76-9c7c-65bf64296d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.540209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20700826-842c-4d76-9c7c-65bf64296d94 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.551501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1170/2344] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:27.670957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:27.672704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.686566 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9c44-11d9-4591-9806-112cc3b7e467 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:27.692338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699eae-088d-4d4d-a9c4-8dae92303338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:27.693000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699eae-088d-4d4d-a9c4-8dae92303338 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:27.693279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699eae-088d-4d4d-a9c4-8dae92303338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:27.693555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699eae-088d-4d4d-a9c4-8dae92303338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:27.695336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-fc699eae-088d-4d4d-a9c4-8dae92303338 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:27.777733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699eae-088d-4d4d-a9c4-8dae92303338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:27.777733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc699eae-088d-4d4d-a9c4-8dae92303338 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:27.784630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1175/2345] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:28.562976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6f73-a2d7-49cf-b582-72e98240f753 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:28.563580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6f73-a2d7-49cf-b582-72e98240f753 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:28.563580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f6f73-a2d7-49cf-b582-72e98240f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:28.588513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:28.589217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:28.589865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:28.625842 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:28.626808 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:28.661097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-416f6f73-a2d7-49cf-b582-72e98240f753 None None] MFA Rules not processed for user `9e964d23f9b041a5a63735c2c78d8ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:28.662955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-416f6f73-a2d7-49cf-b582-72e98240f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:28.776685 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1176/2346] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:28.782788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:28.785741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:28.838119 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1171/2347] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:28.839407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f6f73-a2d7-49cf-b582-72e98240f753 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:28.861402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f6f73-a2d7-49cf-b582-72e98240f753 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:28.875296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:28.877736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:28.878576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:28.878576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:28.880105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:28.890402 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:28.925295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:28.948106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1172/2348] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:28 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:28.950522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:28.959396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650ccd3-ebe5-4275-8210-b1e6ee2ab03f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:29.131759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:29.132647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.132934 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.133212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.165693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481fde5-d309-4d9f-80da-8bdcad074068 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:29.179778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:29.181047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.182262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.182739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.185359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:29.188697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:29.230686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1173/2349] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:28 2022] POST /identity/v3/users => generated 307 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:29.237782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:29.253952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:29.257301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:29.260361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbb1d9-6046-42d8-8559-4cb4c5f928ec admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:29.289313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:29.291326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.294086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.294702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.295317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:29.299001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:29.315910 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1177/2350] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:17:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 16:17:29.324714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1174/2351] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:29.331714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:29.350234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf9e21-51fa-4ab1-88f1-ecf634a833e5 service swift] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:29.379182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:29.382490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.382787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.383662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] PATH_INFO: `/v3/projects/5c91c38128dc4bea87e323719cc7e2e1/users/a9e2d15248b645eeb862c5159808e609/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.426586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c91c38128dc4bea87e323719cc7e2e1, user_id=a9e2d15248b645eeb862c5159808e609, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:29.443374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:29.509772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1178/2352] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:29 2022] PUT /identity/v3/projects/5c91c38128dc4bea87e323719cc7e2e1/users/a9e2d15248b645eeb862c5159808e609/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:29.510689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:29.527857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9641bc-5687-4d72-b91b-eaff3b6427ae admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:29.543728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:29.705463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:29.706103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.706578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.706862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.707713 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:29.709794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:29.728761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1175/2353] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:29.729600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:29.746919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db757857-50cc-465d-8006-33cd679875ce admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:29.767110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b8462-27ce-4999-8711-9e6835ed2c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:29.768001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b8462-27ce-4999-8711-9e6835ed2c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:29.768301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b8462-27ce-4999-8711-9e6835ed2c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:29.768581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b8462-27ce-4999-8711-9e6835ed2c4c admin admin] PATH_INFO: `/v3/projects/5c91c38128dc4bea87e323719cc7e2e1/users/a9e2d15248b645eeb862c5159808e609/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:29.771739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b8462-27ce-4999-8711-9e6835ed2c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c91c38128dc4bea87e323719cc7e2e1, user_id=a9e2d15248b645eeb862c5159808e609, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:29.776167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b8462-27ce-4999-8711-9e6835ed2c4c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:29.792510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1179/2354] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:29 2022] PUT /identity/v3/projects/5c91c38128dc4bea87e323719cc7e2e1/users/a9e2d15248b645eeb862c5159808e609/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:30.380366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:30.382233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:30.396142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e891-eec2-4b10-b32b-557bfb4b1af5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:30.462958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:30.463599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:30.463905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:30.464208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] PATH_INFO: `/v3/users/a4b40b399d0c49b7be4f13c3a3c72eeb` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:30.465331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b40b399d0c49b7be4f13c3a3c72eeb)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:30.467655 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:30.528230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b40b399d0c49b7be4f13c3a3c72eeb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:30.536444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b40b399d0c49b7be4f13c3a3c72eeb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:30.537147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b40b399d0c49b7be4f13c3a3c72eeb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:30.552075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b40b399d0c49b7be4f13c3a3c72eeb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:30.559665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-93750b8c-3abd-4d42-a79a-039fb6a4da0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b40b399d0c49b7be4f13c3a3c72eeb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:30.572508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1176/2355] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:30 2022] DELETE /identity/v3/users/a4b40b399d0c49b7be4f13c3a3c72eeb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:30.576974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:30.577259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:30.577534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:30.596727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:30.596962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:30.597556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:30.611705 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:30.613007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:30.642416 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] MFA Rules not processed for user `a9e2d15248b645eeb862c5159808e609`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:30.643796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:30.662701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:30.727374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1180/2356] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:30.737871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:30.740026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:30.748482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:30.794881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1177/2357] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:30.819527 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366079b4-9153-4886-a433-4e1a855b4bab None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:30.826539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1d8f7-13e6-4a1f-8bcd-b972f70519e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:30.828008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1d8f7-13e6-4a1f-8bcd-b972f70519e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:30.828451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1d8f7-13e6-4a1f-8bcd-b972f70519e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:30.828831 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1d8f7-13e6-4a1f-8bcd-b972f70519e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:30.843999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1d8f7-13e6-4a1f-8bcd-b972f70519e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:30.845740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1d8f7-13e6-4a1f-8bcd-b972f70519e3 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:30.859568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1181/2358] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:31.538552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:31.540044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:31.569784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00879b3-3f7b-45d8-9fd5-568a6ce84810 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:31.575243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:31.576639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:31.577184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:31.577558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] PATH_INFO: `/v3/projects/4c7ec8036f064f40b8a89d6b2e1b1b21` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:31.579073 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7ec8036f064f40b8a89d6b2e1b1b21)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:31.581293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:31.639942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7ec8036f064f40b8a89d6b2e1b1b21', 'request_id': 'req-d4926f74-dd70-4add-b299-ea7d971622db'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:31.648530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7ec8036f064f40b8a89d6b2e1b1b21', 'request_id': 'req-d4926f74-dd70-4add-b299-ea7d971622db'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:31.665727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7ec8036f064f40b8a89d6b2e1b1b21', 'request_id': 'req-d4926f74-dd70-4add-b299-ea7d971622db'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:31.680731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] The token cache is being invalidate because project 4c7ec8036f064f40b8a89d6b2e1b1b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:31.681100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:31.681828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d4926f74-dd70-4add-b299-ea7d971622db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:31.683695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1178/2359] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:31 2022] DELETE /identity/v3/projects/4c7ec8036f064f40b8a89d6b2e1b1b21 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:31.689553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ccc8-fa2a-486b-b84d-e2b7a9aedb52 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:31.689852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ccc8-fa2a-486b-b84d-e2b7a9aedb52 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:31.690166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ccc8-fa2a-486b-b84d-e2b7a9aedb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:31.712049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f665ccc8-fa2a-486b-b84d-e2b7a9aedb52 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:31.713357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f665ccc8-fa2a-486b-b84d-e2b7a9aedb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:31.793951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1182/2360] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:31.803198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0059ae0-fae1-45d6-b109-c27c283f273e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:31.803684 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0059ae0-fae1-45d6-b109-c27c283f273e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:31.803775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0059ae0-fae1-45d6-b109-c27c283f273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:31.829750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e0059ae0-fae1-45d6-b109-c27c283f273e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:31.830991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e0059ae0-fae1-45d6-b109-c27c283f273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:31.842880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1179/2361] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:31.847165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ccc8-fa2a-486b-b84d-e2b7a9aedb52 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:31.857637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ccc8-fa2a-486b-b84d-e2b7a9aedb52 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:31.862201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:31.862812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:31.863087 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:31.863364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:31.864066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:31.864374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:31.866007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:31.882115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1183/2362] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:31.883263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0059ae0-fae1-45d6-b109-c27c283f273e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:31.893874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0059ae0-fae1-45d6-b109-c27c283f273e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:31.898918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:31.899522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:31.899815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:31.900103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:31.900723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:31.902603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:31.931184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1180/2363] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:31 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:31.935956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:31.946077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38605-cc8e-4e4a-893d-2be9deeb039b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.007197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.007734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.008086 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.008351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.009113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.011138 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.037591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1184/2364] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:31 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:32.041244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.053274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a844c6-97f8-4646-907c-2060ab5ba3b4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.058198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.058804 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.059080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.059352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.060144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.062114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.072525 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1181/2365] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:32.077409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.087894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7d04-b61e-440d-bea3-2f1e9f176ea6 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.094532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0bfc7-b230-4b60-a96e-3bacc1b1bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.095249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bfc7-b230-4b60-a96e-3bacc1b1bb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.095670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bfc7-b230-4b60-a96e-3bacc1b1bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.096032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0bfc7-b230-4b60-a96e-3bacc1b1bb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.096700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0bfc7-b230-4b60-a96e-3bacc1b1bb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.099066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0bfc7-b230-4b60-a96e-3bacc1b1bb93 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.121893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1185/2366] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:32.126842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.138451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f24063-3db0-472a-9076-3177cc6ffa99 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.144372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.145057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.145336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.145612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] PATH_INFO: `/v3/projects/5b43d69453684330a73979dd6ca228df/users/7ed41a860d3945bdb1fe93710efafc45/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.163266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b43d69453684330a73979dd6ca228df, user_id=7ed41a860d3945bdb1fe93710efafc45, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.166047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.185515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1182/2367] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:32 2022] PUT /identity/v3/projects/5b43d69453684330a73979dd6ca228df/users/7ed41a860d3945bdb1fe93710efafc45/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:32.195662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614e0b-6b56-468d-87ba-d318cc78874c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.195995 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614e0b-6b56-468d-87ba-d318cc78874c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.196276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614e0b-6b56-468d-87ba-d318cc78874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.228771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:32.233006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-50614e0b-6b56-468d-87ba-d318cc78874c None None] MFA Rules not processed for user `7ed41a860d3945bdb1fe93710efafc45`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:32.235210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-50614e0b-6b56-468d-87ba-d318cc78874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:32.305584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1186/2368] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:32.317792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.319507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:32.352707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:32.395452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35e82-cc65-45c7-bc17-f5006ac11607 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.399075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.399686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.400007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.400433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.409238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.410708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.420238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1183/2369] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:32.448434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.448575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614e0b-6b56-468d-87ba-d318cc78874c None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.449919 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:32.517719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614e0b-6b56-468d-87ba-d318cc78874c None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.518892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ff317-1a45-4560-b97a-48a296350355 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.522208 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.522843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.523121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.523389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] PATH_INFO: `/v3/users/7ed41a860d3945bdb1fe93710efafc45` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.523606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.524262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.524538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed41a860d3945bdb1fe93710efafc45)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.524634 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.524813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] PATH_INFO: `/v3/users/9e964d23f9b041a5a63735c2c78d8ae6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.525964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e964d23f9b041a5a63735c2c78d8ae6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.526513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.527895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.576292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed41a860d3945bdb1fe93710efafc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.576621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e964d23f9b041a5a63735c2c78d8ae6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.577216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed41a860d3945bdb1fe93710efafc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.578073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed41a860d3945bdb1fe93710efafc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.584087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e964d23f9b041a5a63735c2c78d8ae6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.584768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e964d23f9b041a5a63735c2c78d8ae6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.591596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed41a860d3945bdb1fe93710efafc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.597513 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e964d23f9b041a5a63735c2c78d8ae6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.598600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed41a860d3945bdb1fe93710efafc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.605620 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-afb5b012-e6b2-4aa3-897c-276bb66b5733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e964d23f9b041a5a63735c2c78d8ae6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:32.612469 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1184/2370] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:32 2022] DELETE /identity/v3/users/9e964d23f9b041a5a63735c2c78d8ae6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:32.615689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1187/2371] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:32 2022] DELETE /identity/v3/users/7ed41a860d3945bdb1fe93710efafc45 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:32.619149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.619442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.619736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.639593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:32.640832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:32.709442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:32.729723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1185/2372] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:32.757286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.759749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:32.802883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:32.836948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:32.838496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:32.871240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c643eb-67d5-4b69-b5c2-61086c0c90b1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.886399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.887058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.887337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.887613 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] PATH_INFO: `/v3/projects/f56d1e6c388241898d0ff48929ce0d9a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.889888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56d1e6c388241898d0ff48929ce0d9a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.896329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.896775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9f730-e12a-4f3d-a05c-b2840ec1d932 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:32.902657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:32.904213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:32.904700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:32.905334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:32.918189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:32.920947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:32.944068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1188/2373] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:33.065559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56d1e6c388241898d0ff48929ce0d9a', 'request_id': 'req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.074254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56d1e6c388241898d0ff48929ce0d9a', 'request_id': 'req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.090057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56d1e6c388241898d0ff48929ce0d9a', 'request_id': 'req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.130531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] The token cache is being invalidate because project f56d1e6c388241898d0ff48929ce0d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:33.131198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.132227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.140070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1186/2374] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:32 2022] DELETE /identity/v3/projects/f56d1e6c388241898d0ff48929ce0d9a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:33.140381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:33.156023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b5919-d279-4ca9-baee-8842ddc82455 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:33.297475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:33.298191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:33.298475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:33.298749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] PATH_INFO: `/v3/users/a9e2d15248b645eeb862c5159808e609` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:33.302704 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e2d15248b645eeb862c5159808e609)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:33.305430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:33.402041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:33.402215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e2d15248b645eeb862c5159808e609'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.402998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e2d15248b645eeb862c5159808e609'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.404294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e2d15248b645eeb862c5159808e609'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.404465 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:33.422105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e2d15248b645eeb862c5159808e609'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.434169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e2d15248b645eeb862c5159808e609'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.445155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea03e7-d1e5-42d3-a526-9abf0b0adf4d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:33.456409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:33.457518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:33.457703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:33.457985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] PATH_INFO: `/v3/projects/5b43d69453684330a73979dd6ca228df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:33.459195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b43d69453684330a73979dd6ca228df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:33.461934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:33.477000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1189/2375] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:33 2022] DELETE /identity/v3/users/a9e2d15248b645eeb862c5159808e609 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:33.556344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b43d69453684330a73979dd6ca228df', 'request_id': 'req-e3d80cde-1372-414e-a7da-5615af5b7637'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.565318 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b43d69453684330a73979dd6ca228df', 'request_id': 'req-e3d80cde-1372-414e-a7da-5615af5b7637'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.579136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b43d69453684330a73979dd6ca228df', 'request_id': 'req-e3d80cde-1372-414e-a7da-5615af5b7637'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.605071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] The token cache is being invalidate because project 5b43d69453684330a73979dd6ca228df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:33.605886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.608658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e3d80cde-1372-414e-a7da-5615af5b7637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.611518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1187/2376] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:33 2022] DELETE /identity/v3/projects/5b43d69453684330a73979dd6ca228df => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:33.716228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:33.718428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:33.793155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:33.818374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc547d-43bb-475d-a196-3330e5e0370d admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:33.890142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:33.890870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:33.891228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:33.891577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] PATH_INFO: `/v3/projects/5c91c38128dc4bea87e323719cc7e2e1` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:33.893051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c91c38128dc4bea87e323719cc7e2e1)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:33.894960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:33.951606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c91c38128dc4bea87e323719cc7e2e1', 'request_id': 'req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.959592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c91c38128dc4bea87e323719cc7e2e1', 'request_id': 'req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.969128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c91c38128dc4bea87e323719cc7e2e1', 'request_id': 'req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.994211 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] The token cache is being invalidate because project 5c91c38128dc4bea87e323719cc7e2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:33.994582 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:33.995334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-fa8b9e70-07f3-4455-abdd-30a3fb36dc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:34.001476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1190/2377] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:33 2022] DELETE /identity/v3/projects/5c91c38128dc4bea87e323719cc7e2e1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:34.003661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1ccf4-b643-41c9-84f9-1cbe6c747e9a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.004536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1ccf4-b643-41c9-84f9-1cbe6c747e9a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.005031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1ccf4-b643-41c9-84f9-1cbe6c747e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.027610 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a5f1ccf4-b643-41c9-84f9-1cbe6c747e9a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:34.029473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a5f1ccf4-b643-41c9-84f9-1cbe6c747e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:34.097232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:34.111010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1188/2378] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:34.120223 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065f18-a628-4655-8f79-764f26a4ce98 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.120519 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065f18-a628-4655-8f79-764f26a4ce98 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.120778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065f18-a628-4655-8f79-764f26a4ce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.144114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d8065f18-a628-4655-8f79-764f26a4ce98 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:34.145380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d8065f18-a628-4655-8f79-764f26a4ce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:34.157739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1191/2379] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:34.162860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1ccf4-b643-41c9-84f9-1cbe6c747e9a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.173494 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1ccf4-b643-41c9-84f9-1cbe6c747e9a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:34.179727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:34.180696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.180975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.181256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.182091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:34.182396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:34.184051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:34.203260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1189/2380] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:34.208274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065f18-a628-4655-8f79-764f26a4ce98 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.222868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065f18-a628-4655-8f79-764f26a4ce98 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:34.234655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:34.237290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.237655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.237998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.238734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:34.244335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:34.296927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1192/2381] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:34 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:34.303030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.318257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6e7c-60ac-4283-9252-07281e6d2102 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:34.422338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:34.423129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.423648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.424195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.426129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:34.431719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:34.469755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1190/2382] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:34 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:34.473986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.487570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad493a-fa54-48ce-b140-d597cff45b0b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:34.492390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:34.493014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.493294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.493564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.494216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:34.495897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:34.509275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1193/2383] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:34.513555 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.532361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecbb78-e29b-495e-b1a8-da55c5452062 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:34.545797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf21093-46cf-40e7-bc64-b34469a3b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:34.547041 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21093-46cf-40e7-bc64-b34469a3b7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.547736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21093-46cf-40e7-bc64-b34469a3b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.548315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf21093-46cf-40e7-bc64-b34469a3b7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.549359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf21093-46cf-40e7-bc64-b34469a3b7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:34.551854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf21093-46cf-40e7-bc64-b34469a3b7b2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:34.567357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1191/2384] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:34.571470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.582686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9f345-78ec-4b42-99b8-53dbeb491998 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:34.587441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:34.588123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.588398 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.588673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] PATH_INFO: `/v3/projects/2b98e68827c741188eb8b666840243d9/users/4cd9e6afe13c4755981ca42e645ed390/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.607603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b98e68827c741188eb8b666840243d9, user_id=4cd9e6afe13c4755981ca42e645ed390, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:34.610337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:34.626293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1194/2385] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:34 2022] PUT /identity/v3/projects/2b98e68827c741188eb8b666840243d9/users/4cd9e6afe13c4755981ca42e645ed390/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:34.636997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9881b1-df7c-43f0-b0b8-de178e910b19 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.637500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9881b1-df7c-43f0-b0b8-de178e910b19 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.638552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9881b1-df7c-43f0-b0b8-de178e910b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.674063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2d9881b1-df7c-43f0-b0b8-de178e910b19 None None] MFA Rules not processed for user `4cd9e6afe13c4755981ca42e645ed390`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:34.675520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2d9881b1-df7c-43f0-b0b8-de178e910b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:34.758388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1192/2386] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:34.764494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.793141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:34.850557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce9432-f150-4bef-89d5-14e47d3807eb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:34.855960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:34.856840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:34.857205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:34.857550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:34.859429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:34.863402 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:34.938838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9881b1-df7c-43f0-b0b8-de178e910b19 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:34.944622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1195/2387] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:34 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:34.951088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9881b1-df7c-43f0-b0b8-de178e910b19 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.004111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:35.014960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.015591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.015901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.016181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.016807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:35.018722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:35.049360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.060906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1193/2388] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:34 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:35.062261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d16d5-a374-484f-8b20-8d34babe511a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.067523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.068180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.068464 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.068922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.069583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:35.071246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:35.088947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.099978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1196/2389] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:35.103255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce244f4-f80e-4127-b5dd-abf3844c6b13 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.108719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.109396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.109697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.109976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] PATH_INFO: `/v3/projects/0a68ccd71a06499fb708d929c0008332/users/e57930c9e88a4db08d3ef7a6192388c8/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.139125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a68ccd71a06499fb708d929c0008332, user_id=e57930c9e88a4db08d3ef7a6192388c8, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:35.142097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:35.157538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1194/2390] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:35 2022] PUT /identity/v3/projects/0a68ccd71a06499fb708d929c0008332/users/e57930c9e88a4db08d3ef7a6192388c8/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:35.161432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.174280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f14a-fc85-41bd-986a-4b27862955e1 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.267155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd23e7-954a-412b-9f5f-145ddb4917a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.267772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd23e7-954a-412b-9f5f-145ddb4917a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.268082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd23e7-954a-412b-9f5f-145ddb4917a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.268356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd23e7-954a-412b-9f5f-145ddb4917a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.269005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd23e7-954a-412b-9f5f-145ddb4917a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:35.270675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd23e7-954a-412b-9f5f-145ddb4917a5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:35.281469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1197/2391] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:35.285424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.296717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35ff0e-f66c-4b65-8e9d-e175df5ad099 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.301571 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.302232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.302511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.302785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] PATH_INFO: `/v3/projects/0a68ccd71a06499fb708d929c0008332/users/e57930c9e88a4db08d3ef7a6192388c8/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.304745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a68ccd71a06499fb708d929c0008332, user_id=e57930c9e88a4db08d3ef7a6192388c8, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:35.307364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:35.320631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1195/2392] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:35 2022] PUT /identity/v3/projects/0a68ccd71a06499fb708d929c0008332/users/e57930c9e88a4db08d3ef7a6192388c8/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:35.332178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935385c1-15b1-4834-afdc-226fdd1f482b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.332462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935385c1-15b1-4834-afdc-226fdd1f482b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.332733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935385c1-15b1-4834-afdc-226fdd1f482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.371488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-935385c1-15b1-4834-afdc-226fdd1f482b None None] MFA Rules not processed for user `e57930c9e88a4db08d3ef7a6192388c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:35.373096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-935385c1-15b1-4834-afdc-226fdd1f482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:35.453602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1198/2393] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:35.467452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.469243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:35.538352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6acd6a-d849-42d4-b50a-3e519816f83f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.541974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f67019-eb15-4ed3-81b9-f5864b736820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.542583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f67019-eb15-4ed3-81b9-f5864b736820 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.542863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f67019-eb15-4ed3-81b9-f5864b736820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.543134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f67019-eb15-4ed3-81b9-f5864b736820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.553244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f67019-eb15-4ed3-81b9-f5864b736820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:35.554670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f67019-eb15-4ed3-81b9-f5864b736820 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:35.564621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1196/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:35.640837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935385c1-15b1-4834-afdc-226fdd1f482b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.656209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:35.740004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935385c1-15b1-4834-afdc-226fdd1f482b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:35.750059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:35.750733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.751007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.751443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] PATH_INFO: `/v3/users/4cd9e6afe13c4755981ca42e645ed390` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.752730 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd9e6afe13c4755981ca42e645ed390)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:35.754752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:35.813800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd9e6afe13c4755981ca42e645ed390'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:35.814540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd9e6afe13c4755981ca42e645ed390'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:35.815212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd9e6afe13c4755981ca42e645ed390'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:35.828032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd9e6afe13c4755981ca42e645ed390'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:35.834912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd9e6afe13c4755981ca42e645ed390'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:35.848764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1199/2395] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:35 2022] DELETE /identity/v3/users/4cd9e6afe13c4755981ca42e645ed390 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:35.853576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:35.853869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:35.854150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:35.874279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:35.875695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:35.959006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1197/2396] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:35.971777 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:35.973258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:36.033461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ed944-9f54-42d5-b563-8646e0911a75 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:36.037169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:36.037780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:36.038064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:36.038339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:36.047740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:36.049212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:36.058930 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1200/2397] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:36.385868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:36.389279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:36.404024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de891121-c170-4e0f-84b6-741a7d69de68 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:36.424000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:36.424719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:36.425005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:36.425847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] PATH_INFO: `/v3/projects/2b98e68827c741188eb8b666840243d9` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:36.427127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b98e68827c741188eb8b666840243d9)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:36.429929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:36.562771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b98e68827c741188eb8b666840243d9', 'request_id': 'req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.564866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:36.574703 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b98e68827c741188eb8b666840243d9', 'request_id': 'req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.587014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b98e68827c741188eb8b666840243d9', 'request_id': 'req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.605397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] The token cache is being invalidate because project 2b98e68827c741188eb8b666840243d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:36.605920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.607463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.610702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1198/2398] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:36 2022] DELETE /identity/v3/projects/2b98e68827c741188eb8b666840243d9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:36.615380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:36.632974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704acd5-21e6-452b-9921-b283916a49be service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:36.684189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:36.720714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:36.721707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:36.722244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:36.722655 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] PATH_INFO: `/v3/users/e57930c9e88a4db08d3ef7a6192388c8` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:36.726124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57930c9e88a4db08d3ef7a6192388c8)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:36.729695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:36.808210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57930c9e88a4db08d3ef7a6192388c8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.808912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57930c9e88a4db08d3ef7a6192388c8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.810111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57930c9e88a4db08d3ef7a6192388c8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.826967 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57930c9e88a4db08d3ef7a6192388c8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.844923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9e11b5c2-311e-450d-8b73-5ceba68edce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57930c9e88a4db08d3ef7a6192388c8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:36.861328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1201/2399] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:36 2022] DELETE /identity/v3/users/e57930c9e88a4db08d3ef7a6192388c8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:37.331114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:37.333956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:37.356968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87616c-14e8-4cc3-a5af-6e8cea8dc28a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:37.442865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:37.443629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:37.443871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:37.444172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] PATH_INFO: `/v3/projects/0a68ccd71a06499fb708d929c0008332` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:37.445579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a68ccd71a06499fb708d929c0008332)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:37.447653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:37.529110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a68ccd71a06499fb708d929c0008332', 'request_id': 'req-f143f972-5763-4154-be1b-c161db55007e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:37.540268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a68ccd71a06499fb708d929c0008332', 'request_id': 'req-f143f972-5763-4154-be1b-c161db55007e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:37.550087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a68ccd71a06499fb708d929c0008332', 'request_id': 'req-f143f972-5763-4154-be1b-c161db55007e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:37.563857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] The token cache is being invalidate because project 0a68ccd71a06499fb708d929c0008332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:37.564154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:37.564854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f143f972-5763-4154-be1b-c161db55007e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:37.566551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1199/2400] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:37 2022] DELETE /identity/v3/projects/0a68ccd71a06499fb708d929c0008332 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:37.573557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207483c-7260-4506-bfe6-dbd11c547ae5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:37.574105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207483c-7260-4506-bfe6-dbd11c547ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:37.574266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207483c-7260-4506-bfe6-dbd11c547ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:37.598237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-8207483c-7260-4506-bfe6-dbd11c547ae5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:37.600083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8207483c-7260-4506-bfe6-dbd11c547ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:37.716861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1202/2401] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:37.725384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d38b0-060c-49aa-bdf8-615d6dc51797 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:37.725651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d38b0-060c-49aa-bdf8-615d6dc51797 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:37.725892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d38b0-060c-49aa-bdf8-615d6dc51797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:37.750203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3f6d38b0-060c-49aa-bdf8-615d6dc51797 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:37.757394 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3f6d38b0-060c-49aa-bdf8-615d6dc51797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:37.792004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1200/2402] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:37.801107 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207483c-7260-4506-bfe6-dbd11c547ae5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:37.815123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207483c-7260-4506-bfe6-dbd11c547ae5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:37.821105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:37.822077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:37.822542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:37.822990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:37.823665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:37.824015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:37.826494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:37.842692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1203/2403] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:37.846737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d38b0-060c-49aa-bdf8-615d6dc51797 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:37.857065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d38b0-060c-49aa-bdf8-615d6dc51797 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:37.863536 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:37.864277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:37.864497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:37.864775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:37.865415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:37.867343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:37.906572 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1201/2404] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:37 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:37.910485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:37.921846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba440c-4d08-4ccb-a648-2435a80f435d admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:37.967478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:37.991535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:37.992277 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:37.992568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:37.992909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:37.993598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:37.995742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.020874 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1204/2405] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:37 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:38.025543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.037547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1e7b5-4936-475e-ab8f-99d089a35cb0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.042705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.044903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.044903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.044903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.045681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.047338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.067752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1202/2406] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:38.074765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.093816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9e568-4d4c-483e-85d1-c0bc5ec78901 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.100364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6939-e487-4a99-ad83-cf96b2acafad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.101531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6939-e487-4a99-ad83-cf96b2acafad admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.102099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6939-e487-4a99-ad83-cf96b2acafad admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.102567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6939-e487-4a99-ad83-cf96b2acafad admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.103469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae6939-e487-4a99-ad83-cf96b2acafad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.105681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae6939-e487-4a99-ad83-cf96b2acafad admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.125106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1205/2407] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:38.125478 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.137434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cabfca-d920-438b-9d09-7e4f86c1e530 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.146715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.148590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.149214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.150515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] PATH_INFO: `/v3/projects/78b57dd26e01445abe936df63625794d/users/b3896518de974cf2b8a4e3c636d7452a/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.171872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b57dd26e01445abe936df63625794d, user_id=b3896518de974cf2b8a4e3c636d7452a, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.179250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.195702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:38.218274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d431-edbd-4726-b72f-ebea61bc486a None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.218569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d431-edbd-4726-b72f-ebea61bc486a None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.218747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1203/2408] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:38 2022] PUT /identity/v3/projects/78b57dd26e01445abe936df63625794d/users/b3896518de974cf2b8a4e3c636d7452a/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:38.218891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d431-edbd-4726-b72f-ebea61bc486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.334589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f489d431-edbd-4726-b72f-ebea61bc486a None None] MFA Rules not processed for user `b3896518de974cf2b8a4e3c636d7452a`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:38.336285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f489d431-edbd-4726-b72f-ebea61bc486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:38.480547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1206/2409] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:38.485599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.581519 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab603620-3a5a-4457-984c-f424d50e253a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.586585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.587208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.587489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.587772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.588659 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.590564 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.637266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1204/2410] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:38 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:38.641259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d431-edbd-4726-b72f-ebea61bc486a None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.665914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d431-edbd-4726-b72f-ebea61bc486a None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.771997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.772775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.773230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.773493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.774276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.776531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.816341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1207/2411] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:38 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:38.816590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.846081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63e981-43a9-45c5-bc3a-7cfdce8473ed admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.867471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.868485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.869000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.869484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.870353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.872287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.885793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1205/2412] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:38.890469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.904816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561ed6f-d471-4dff-9327-c72b04789570 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.914905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.915849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.915994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.916171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] PATH_INFO: `/v3/projects/992aad84d69448cfbe40321b0e7c04b8/users/c9c2e49b0be74eda8d3d0b53f653a175/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.938269 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992aad84d69448cfbe40321b0e7c04b8, user_id=c9c2e49b0be74eda8d3d0b53f653a175, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.941663 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.958578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1208/2413] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:38 2022] PUT /identity/v3/projects/992aad84d69448cfbe40321b0e7c04b8/users/c9c2e49b0be74eda8d3d0b53f653a175/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:38.962358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:39.002806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c554df-e0f4-4f16-9532-77bce33adb51 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:39.134101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:39.134791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:39.135158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:39.135501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:39.136325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:39.139648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:39.151850 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1206/2414] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:39.156009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:39.168457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddf5ce-ec8d-4864-bab6-1a3411ec0873 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:39.174939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:39.176950 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:39.178069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacc829-f903-4e55-8ba7-51019abf5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:39.179244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc829-f903-4e55-8ba7-51019abf5be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:39.179946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc829-f903-4e55-8ba7-51019abf5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:39.181189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacc829-f903-4e55-8ba7-51019abf5be2 admin admin] PATH_INFO: `/v3/projects/992aad84d69448cfbe40321b0e7c04b8/users/c9c2e49b0be74eda8d3d0b53f653a175/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:39.183761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacc829-f903-4e55-8ba7-51019abf5be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992aad84d69448cfbe40321b0e7c04b8, user_id=c9c2e49b0be74eda8d3d0b53f653a175, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:39.188059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacc829-f903-4e55-8ba7-51019abf5be2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:39.192343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5307fa6-23d8-4866-a108-7d42531359df admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:39.208079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1209/2415] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:39 2022] PUT /identity/v3/projects/992aad84d69448cfbe40321b0e7c04b8/users/c9c2e49b0be74eda8d3d0b53f653a175/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:39.211890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:39.212591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882318b-ca4d-49b2-85d8-e217cf90d2d5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:39.212862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:39.212987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882318b-ca4d-49b2-85d8-e217cf90d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:39.213149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:39.213247 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882318b-ca4d-49b2-85d8-e217cf90d2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:39.213439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] PATH_INFO: `/v3/users/3ebf7cc4153d4dbe857dce5edda74afc` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:39.214920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebf7cc4153d4dbe857dce5edda74afc)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:39.217883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:39.225246 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:39.253925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c882318b-ca4d-49b2-85d8-e217cf90d2d5 None None] MFA Rules not processed for user `c9c2e49b0be74eda8d3d0b53f653a175`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:39.255232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c882318b-ca4d-49b2-85d8-e217cf90d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:39.301886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebf7cc4153d4dbe857dce5edda74afc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:39.311547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebf7cc4153d4dbe857dce5edda74afc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:39.312386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebf7cc4153d4dbe857dce5edda74afc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:39.320021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:39.331219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebf7cc4153d4dbe857dce5edda74afc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:39.343263 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebf7cc4153d4dbe857dce5edda74afc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:39.345840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1210/2416] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:39.352920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1207/2417] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:39 2022] DELETE /identity/v3/users/3ebf7cc4153d4dbe857dce5edda74afc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:39.358021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:39.360063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:39.360063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:39.360063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:39.364706 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:39.396440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:39.397727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:39.511887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1211/2418] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:39.524878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ade5-b8d9-45d8-bd50-18e3eb2a5b88 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:39.536827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:39.537400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:39.537677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:39.537952 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:39.547483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:39.548005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:39.548005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:39.665615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629ac3-d3b3-4ad5-8637-e8c9017912aa None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:39.671397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:39.672197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:39.672658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:39.673055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:39.693346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:39.694826 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:39.704928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:39.705734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1212/2419] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:39.714153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:39.737805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1208/2420] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:40.543043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:40.545318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:40.570221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc16ac-bc9e-433f-b17e-baaa25acab6d service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:40.582514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:40.583786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:40.584121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:40.584675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] PATH_INFO: `/v3/projects/34833bafae3f4233bd9a4c104bc3140f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:40.586085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34833bafae3f4233bd9a4c104bc3140f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:40.588256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:40.631567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:40.655461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34833bafae3f4233bd9a4c104bc3140f', 'request_id': 'req-e55b8cff-a45d-4f89-890a-fa5f9aa92920'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.661703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34833bafae3f4233bd9a4c104bc3140f', 'request_id': 'req-e55b8cff-a45d-4f89-890a-fa5f9aa92920'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.671844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34833bafae3f4233bd9a4c104bc3140f', 'request_id': 'req-e55b8cff-a45d-4f89-890a-fa5f9aa92920'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.690320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] The token cache is being invalidate because project 34833bafae3f4233bd9a4c104bc3140f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:40.690852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.700596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.705695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1213/2421] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:40 2022] DELETE /identity/v3/projects/34833bafae3f4233bd9a4c104bc3140f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:40.716103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:40.733644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd713cf-7d0a-425f-a98c-73dfd8fe71c6 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:40.751863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:40.757003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:40.857854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:40.858778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:40.859219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:40.859503 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] PATH_INFO: `/v3/users/b140b001a0f24e0ea5277a1ea1a3043f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:40.860379 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b8cff-a45d-4f89-890a-fa5f9aa92920 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:40.865205 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b140b001a0f24e0ea5277a1ea1a3043f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:40.867184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:40.879114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:40.879780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:40.880097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:40.880377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] PATH_INFO: `/v3/users/b3896518de974cf2b8a4e3c636d7452a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:40.882128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3896518de974cf2b8a4e3c636d7452a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:40.884579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:40.917279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:40.946374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b140b001a0f24e0ea5277a1ea1a3043f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.947090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3896518de974cf2b8a4e3c636d7452a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.947909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3896518de974cf2b8a4e3c636d7452a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.948767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3896518de974cf2b8a4e3c636d7452a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.956408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b140b001a0f24e0ea5277a1ea1a3043f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.957140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b140b001a0f24e0ea5277a1ea1a3043f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.962129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3896518de974cf2b8a4e3c636d7452a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.970038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b140b001a0f24e0ea5277a1ea1a3043f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.970258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3896518de974cf2b8a4e3c636d7452a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.978099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a200517e-5ec7-40b1-9408-2d2906ccfb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b140b001a0f24e0ea5277a1ea1a3043f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:40.985158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1209/2422] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:40 2022] DELETE /identity/v3/users/b140b001a0f24e0ea5277a1ea1a3043f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:40.990136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1214/2423] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:40 2022] DELETE /identity/v3/users/b3896518de974cf2b8a4e3c636d7452a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:40.995672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:40.996000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:40.996449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:41.023437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:41.024759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:41.146404 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1210/2424] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:41.158640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:41.160125 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:41.220749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:41.267135 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234507f-fb05-4c80-8c6c-df89f6873b69 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:41.272255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4b073-b6c8-4d55-ab4d-b0eb77b8f067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:41.272707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4b073-b6c8-4d55-ab4d-b0eb77b8f067 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:41.272902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4b073-b6c8-4d55-ab4d-b0eb77b8f067 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:41.273186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4b073-b6c8-4d55-ab4d-b0eb77b8f067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:41.286088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4b073-b6c8-4d55-ab4d-b0eb77b8f067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:41.287668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4b073-b6c8-4d55-ab4d-b0eb77b8f067 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:41.298978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1215/2425] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:41.668410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:41.671332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:41.694450 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ec29e-ff3a-43c5-aecb-0acd0d520e8e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:41.737047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:41.743270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:41.748306 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:41.749871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] PATH_INFO: `/v3/projects/9509307a3c9c4d02b558fa06cab666af` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:41.758846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9509307a3c9c4d02b558fa06cab666af)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:41.765151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:41.905304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9509307a3c9c4d02b558fa06cab666af', 'request_id': 'req-77e07f33-5595-4bea-a00e-0112c017c34a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:41.916363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9509307a3c9c4d02b558fa06cab666af', 'request_id': 'req-77e07f33-5595-4bea-a00e-0112c017c34a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:41.928336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9509307a3c9c4d02b558fa06cab666af', 'request_id': 'req-77e07f33-5595-4bea-a00e-0112c017c34a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:41.954458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] The token cache is being invalidate because project 9509307a3c9c4d02b558fa06cab666af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:41.954881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:41.955577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:41.960375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1211/2426] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:41 2022] DELETE /identity/v3/projects/9509307a3c9c4d02b558fa06cab666af => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:41.962039 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3ee7-522d-4fe4-a756-b99b177fcf26 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:41.962535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3ee7-522d-4fe4-a756-b99b177fcf26 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:41.962634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e3ee7-522d-4fe4-a756-b99b177fcf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:41.999969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-622e3ee7-522d-4fe4-a756-b99b177fcf26 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:42.001329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-622e3ee7-522d-4fe4-a756-b99b177fcf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:42.040761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.042201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:42.122331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:42.132968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1216/2427] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:42.149701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3105a-d5f6-4666-9841-9baf2314f888 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.155878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3105a-d5f6-4666-9841-9baf2314f888 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.156178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3105a-d5f6-4666-9841-9baf2314f888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.188386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07f33-5595-4bea-a00e-0112c017c34a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.192652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-84a3105a-d5f6-4666-9841-9baf2314f888 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:42.193885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-84a3105a-d5f6-4666-9841-9baf2314f888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:42.203975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1217/2428] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:42.207793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.208147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3105a-d5f6-4666-9841-9baf2314f888 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.208826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.209172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.210088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] PATH_INFO: `/v3/projects/78b57dd26e01445abe936df63625794d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.212738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b57dd26e01445abe936df63625794d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.218565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.218856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3105a-d5f6-4666-9841-9baf2314f888 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.233822 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.234455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.234776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.235020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.235682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:42.236032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.237669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.251058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1218/2429] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:17:42.255172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.266155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb54a68-9b43-4311-a983-7dbfdb06c4d1 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.277737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b57dd26e01445abe936df63625794d', 'request_id': 'req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.287088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b57dd26e01445abe936df63625794d', 'request_id': 'req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.299990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b57dd26e01445abe936df63625794d', 'request_id': 'req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.322632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] The token cache is being invalidate because project 78b57dd26e01445abe936df63625794d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:42.322926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.324721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.328193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1212/2430] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:42 2022] DELETE /identity/v3/projects/78b57dd26e01445abe936df63625794d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:42.333080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.335082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:42.352753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.353375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.353656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.353931 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.354619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.357372 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.394129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1219/2431] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:42.398887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.400881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:42.422143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079e0ff-a6e6-4bf6-a2db-959b2045e9dd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.484893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:42.499963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.500606 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.500891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.501172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] PATH_INFO: `/v3/users/c9c2e49b0be74eda8d3d0b53f653a175` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.502331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c2e49b0be74eda8d3d0b53f653a175)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.504329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.505904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c3cfc-ad12-41c2-b2fb-db6d46b3334c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.511061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.511668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.511983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.512260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.513061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.515047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.516898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:42.536221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1220/2432] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:42 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:42.540987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.553512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a5619-a028-4313-8c80-ce85c47f1873 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.558814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.560092 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.560345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.560620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.560986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c2e49b0be74eda8d3d0b53f653a175'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.561271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.563043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.569665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c2e49b0be74eda8d3d0b53f653a175'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.570808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c2e49b0be74eda8d3d0b53f653a175'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.573860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1221/2433] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:42.578235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.591424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c2e49b0be74eda8d3d0b53f653a175'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.598665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c0ae8-d327-49c8-bde4-d70ac8d63054 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.606749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a7221-aba5-4f56-9540-a48af0e5e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.607397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7221-aba5-4f56-9540-a48af0e5e788 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.607736 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7221-aba5-4f56-9540-a48af0e5e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.608063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7221-aba5-4f56-9540-a48af0e5e788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.608723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a7221-aba5-4f56-9540-a48af0e5e788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.609553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c2e49b0be74eda8d3d0b53f653a175'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:42.610462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a7221-aba5-4f56-9540-a48af0e5e788 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.626417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1213/2434] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:42 2022] DELETE /identity/v3/users/c9c2e49b0be74eda8d3d0b53f653a175 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:42.653987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1222/2435] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:42.658190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:42.660423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:42.817544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712d8b2-8971-4ff3-846e-a53cc211bd37 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:42.838802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:42.839121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.839435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.839721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] PATH_INFO: `/v3/projects/07cd27d906cc4496bdeaf929ff4ec21e/users/f945c8c54cb14c0da00b647663278410/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:42.897598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cd27d906cc4496bdeaf929ff4ec21e, user_id=f945c8c54cb14c0da00b647663278410, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:42.905856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:42.934358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1214/2436] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:42 2022] PUT /identity/v3/projects/07cd27d906cc4496bdeaf929ff4ec21e/users/f945c8c54cb14c0da00b647663278410/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:42.939949 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:42.940428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:42.940558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.003115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:43.005430 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:43.134354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1223/2437] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:43.148155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.150316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:43.181434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.183020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:43.203103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165899f5-3b32-4952-8929-ef44ca0b7a24 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.220724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.225214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.225609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.226048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] PATH_INFO: `/v3/projects/992aad84d69448cfbe40321b0e7c04b8` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.228976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992aad84d69448cfbe40321b0e7c04b8)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.233773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.253937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a3551-4864-4bc7-bba9-3edc7c095f93 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.265795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31e8be-b5c2-46bd-afac-b79ba8260d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.266587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e8be-b5c2-46bd-afac-b79ba8260d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.266883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e8be-b5c2-46bd-afac-b79ba8260d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.272176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31e8be-b5c2-46bd-afac-b79ba8260d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.296488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e8be-b5c2-46bd-afac-b79ba8260d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.299378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31e8be-b5c2-46bd-afac-b79ba8260d2a service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.313406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992aad84d69448cfbe40321b0e7c04b8', 'request_id': 'req-49737861-df2b-480f-b8aa-76c62721f8d3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:43.319976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1215/2438] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:43.320106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992aad84d69448cfbe40321b0e7c04b8', 'request_id': 'req-49737861-df2b-480f-b8aa-76c62721f8d3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:43.329100 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992aad84d69448cfbe40321b0e7c04b8', 'request_id': 'req-49737861-df2b-480f-b8aa-76c62721f8d3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:43.341637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] The token cache is being invalidate because project 992aad84d69448cfbe40321b0e7c04b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:43.342015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:43.342746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-49737861-df2b-480f-b8aa-76c62721f8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:43.344407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1224/2439] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:43 2022] DELETE /identity/v3/projects/992aad84d69448cfbe40321b0e7c04b8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:43.349541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed38a-9ed7-46cf-8172-6749e54d7117 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.349932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed38a-9ed7-46cf-8172-6749e54d7117 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.350268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eed38a-9ed7-46cf-8172-6749e54d7117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.371515 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-26eed38a-9ed7-46cf-8172-6749e54d7117 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:43.372999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-26eed38a-9ed7-46cf-8172-6749e54d7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:43.384122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:43.437011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1216/2440] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:43.445928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b7fa-ff60-41e7-9d53-9aa7adcf1e62 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.445928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b7fa-ff60-41e7-9d53-9aa7adcf1e62 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.446278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b7fa-ff60-41e7-9d53-9aa7adcf1e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.473511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ef47b7fa-ff60-41e7-9d53-9aa7adcf1e62 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:43.475634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ef47b7fa-ff60-41e7-9d53-9aa7adcf1e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:43.486624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1225/2441] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:43.490724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eed38a-9ed7-46cf-8172-6749e54d7117 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.501194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eed38a-9ed7-46cf-8172-6749e54d7117 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.505986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.506590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.506870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.507144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.507791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:43.508125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.509710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.523863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1217/2442] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:43.527391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b7fa-ff60-41e7-9d53-9aa7adcf1e62 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.538522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b7fa-ff60-41e7-9d53-9aa7adcf1e62 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.545002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.545632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.545980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.546364 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.547064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.549083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.583855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1226/2443] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:43 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:43.586709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.597001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb38c8-680a-4ee0-a182-6019ef484c12 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.658335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.658961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.659247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.659528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.660210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.662588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.686307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1218/2444] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:43 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:43.689427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.696675 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:43.701956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a338e9-256d-4b7c-a07d-c078060d3634 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.709273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.709975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.710261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.710559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.711369 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.713356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.726625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1227/2445] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:43.730899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.742931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc887ab6-3950-4578-be1f-519820fa5fda admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.748609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bd2ad-a398-43ae-bcff-f3f869e003b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.749225 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd2ad-a398-43ae-bcff-f3f869e003b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.749504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd2ad-a398-43ae-bcff-f3f869e003b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.749904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd2ad-a398-43ae-bcff-f3f869e003b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.750561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bd2ad-a398-43ae-bcff-f3f869e003b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.752213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bd2ad-a398-43ae-bcff-f3f869e003b1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.768188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1219/2446] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:43.769525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.783658 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170e512-7413-4bc2-b8d8-fffa8a8ffa92 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:43.789500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:43.790336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.790899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.791598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] PATH_INFO: `/v3/projects/1bdba0dc63f94a09848b1ef670c972f6/users/dbc077590e514dbd837a1f6aaf65ac5f/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.808213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdba0dc63f94a09848b1ef670c972f6, user_id=dbc077590e514dbd837a1f6aaf65ac5f, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:43.811919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:43.828273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1228/2447] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:43 2022] PUT /identity/v3/projects/1bdba0dc63f94a09848b1ef670c972f6/users/dbc077590e514dbd837a1f6aaf65ac5f/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:43.838802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998b30-c10c-4df7-971e-23c6cf93e3ff None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:43.839359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998b30-c10c-4df7-971e-23c6cf93e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:43.839471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c998b30-c10c-4df7-971e-23c6cf93e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:43.870380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8c998b30-c10c-4df7-971e-23c6cf93e3ff None None] MFA Rules not processed for user `dbc077590e514dbd837a1f6aaf65ac5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:43.871597 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8c998b30-c10c-4df7-971e-23c6cf93e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:43.940984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1220/2448] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:43.952832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:43.954703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:44.023643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1ac35-6887-413f-8a06-4e01708fa7eb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:44.027584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:44.028854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:44.029154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:44.029542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:44.038902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:44.040397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:44.050576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1229/2449] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:17:44.398366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7484-6285-4abf-a052-368019611bf6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:44.398662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7484-6285-4abf-a052-368019611bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:44.398936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be7484-6285-4abf-a052-368019611bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:44.451102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:44.484189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-15be7484-6285-4abf-a052-368019611bf6 None None] MFA Rules not processed for user `f945c8c54cb14c0da00b647663278410`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:44.485315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-15be7484-6285-4abf-a052-368019611bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:44.611446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1221/2450] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:44.623531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:44.625271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:44.646534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deace3a8-6590-4204-8c72-490e2f03809b service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:44.659479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:44.660857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:44.660857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:44.660857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:44.680336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:44.681818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:44.696971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1230/2451] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:46.198011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ede595-5ab0-4eba-9843-7a213d0a7fc8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:46.199012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ede595-5ab0-4eba-9843-7a213d0a7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:46.199528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ede595-5ab0-4eba-9843-7a213d0a7fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:46.224437 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-14ede595-5ab0-4eba-9843-7a213d0a7fc8 None None] MFA Rules not processed for user `f945c8c54cb14c0da00b647663278410`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:46.226007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-14ede595-5ab0-4eba-9843-7a213d0a7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:46.233692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1222/2452] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:49.976059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:49.978116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:50.102819 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793d40a-879a-4f94-abcf-9dfec9def333 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:50.111110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:50.111788 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:50.112097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:50.112380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] PATH_INFO: `/v3/users/6aff6b9a8d264a67916948858a705f79` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:50.113607 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aff6b9a8d264a67916948858a705f79)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:50.118916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:50.227698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aff6b9a8d264a67916948858a705f79'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.227698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aff6b9a8d264a67916948858a705f79'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.227698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aff6b9a8d264a67916948858a705f79'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.245250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:50.248147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aff6b9a8d264a67916948858a705f79'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.257542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aff6b9a8d264a67916948858a705f79'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.273601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1231/2453] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:49 2022] DELETE /identity/v3/users/6aff6b9a8d264a67916948858a705f79 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:50.278603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:50.279070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:50.279151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:50.299992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:50.301541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:50.390991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1223/2454] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:50.401251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:50.403406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:50.471321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38519ea-cf1e-49f8-846e-7478e48a506e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:50.476089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3613d3f-f96c-4e09-a900-735204424cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:50.476706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3613d3f-f96c-4e09-a900-735204424cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:50.476989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3613d3f-f96c-4e09-a900-735204424cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:50.477265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3613d3f-f96c-4e09-a900-735204424cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:50.487225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3613d3f-f96c-4e09-a900-735204424cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:50.488716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3613d3f-f96c-4e09-a900-735204424cd2 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:50.499144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1232/2455] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:50.810231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:50.812074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:50.826598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0209d9-39e5-4b57-92d7-db3d28c38174 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:50.833289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:50.834784 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:50.835294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:50.836024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] PATH_INFO: `/v3/projects/e87e274a10e94a62b9aedc80da9ba3a1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:50.838085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87e274a10e94a62b9aedc80da9ba3a1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:50.841748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:50.893282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87e274a10e94a62b9aedc80da9ba3a1', 'request_id': 'req-c72725ca-cdfe-4078-a06f-c8ef0321e95a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.898832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87e274a10e94a62b9aedc80da9ba3a1', 'request_id': 'req-c72725ca-cdfe-4078-a06f-c8ef0321e95a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.906099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87e274a10e94a62b9aedc80da9ba3a1', 'request_id': 'req-c72725ca-cdfe-4078-a06f-c8ef0321e95a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.917716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] The token cache is being invalidate because project e87e274a10e94a62b9aedc80da9ba3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:50.918005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.919322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c72725ca-cdfe-4078-a06f-c8ef0321e95a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:50.921100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1224/2456] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:50 2022] DELETE /identity/v3/projects/e87e274a10e94a62b9aedc80da9ba3a1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:50.926060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1920-c152-4f38-9b53-5a193cf97579 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:50.926348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1920-c152-4f38-9b53-5a193cf97579 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:50.926677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1920-c152-4f38-9b53-5a193cf97579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:50.947588 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ad1e1920-c152-4f38-9b53-5a193cf97579 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:50.949021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ad1e1920-c152-4f38-9b53-5a193cf97579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:51.017592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1233/2457] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:51.025477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb282c-0925-4609-aecf-8a03a54d522d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.025771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb282c-0925-4609-aecf-8a03a54d522d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.026047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb282c-0925-4609-aecf-8a03a54d522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.046612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7ddb282c-0925-4609-aecf-8a03a54d522d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:51.047838 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7ddb282c-0925-4609-aecf-8a03a54d522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:51.055671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1225/2458] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:51.060270 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1920-c152-4f38-9b53-5a193cf97579 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:51.070056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1920-c152-4f38-9b53-5a193cf97579 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:51.074725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:51.075337 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.075614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.075918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.076567 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:51.076870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:51.078465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:51.091267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1234/2459] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:51.095550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb282c-0925-4609-aecf-8a03a54d522d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:51.105674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb282c-0925-4609-aecf-8a03a54d522d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:51.111026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:51.111631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.111953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.112228 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.112860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:51.114751 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:51.125744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:51.151847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1226/2460] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:51 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:51.156043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:51.166739 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094733-5d44-4413-b539-869f564183c9 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:51.231274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:51.232550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.232550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.232916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.233620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:51.235846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:51.255634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:51.265348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1235/2461] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:51 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:51.270074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:51.293820 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb110e8-f89c-4e30-a9c8-0e2054242a08 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:51.301036 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:51.301729 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.302080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.302399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.303312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:51.305231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:51.318074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1227/2462] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:51.321809 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:51.334160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ad6e1-a2b4-4b61-be04-d66a35cb83e8 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:51.339219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff2f9a-e368-423b-bc22-9f4f61a579bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:51.339983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff2f9a-e368-423b-bc22-9f4f61a579bc admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.340604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff2f9a-e368-423b-bc22-9f4f61a579bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.341075 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff2f9a-e368-423b-bc22-9f4f61a579bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.341867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff2f9a-e368-423b-bc22-9f4f61a579bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:51.343782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff2f9a-e368-423b-bc22-9f4f61a579bc admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:51.358345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1236/2463] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:51.362444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:51.378080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c759d5a-d459-4b46-a11d-adb59ae9e487 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:51.392883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:51.393661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.394020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.394368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] PATH_INFO: `/v3/projects/bba421626bae441fbdf6536ed2bcb512/users/30eecb52931f48888c9369506d6ec580/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.422938 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba421626bae441fbdf6536ed2bcb512, user_id=30eecb52931f48888c9369506d6ec580, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:51.425949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:51.452203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1228/2464] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:51 2022] PUT /identity/v3/projects/bba421626bae441fbdf6536ed2bcb512/users/30eecb52931f48888c9369506d6ec580/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:51.457473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d628a0-ef55-44ac-ba73-cb919928b55d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.458258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d628a0-ef55-44ac-ba73-cb919928b55d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.458538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d628a0-ef55-44ac-ba73-cb919928b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.499203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-06d628a0-ef55-44ac-ba73-cb919928b55d None None] MFA Rules not processed for user `30eecb52931f48888c9369506d6ec580`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:51.500476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-06d628a0-ef55-44ac-ba73-cb919928b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:51.632458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1237/2465] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:51.640957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:51.643501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:51.781620 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee516fb4-d701-4cdf-adb4-4781f72a69e9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:51.788034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:51.788820 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.789277 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.789434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:51.800403 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:51.801843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:51.816761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1229/2466] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:51.996281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9cac-56b5-42b0-b1ee-8d6537db65d8 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:51.996601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9cac-56b5-42b0-b1ee-8d6537db65d8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:51.997217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9cac-56b5-42b0-b1ee-8d6537db65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:52.017636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-09ca9cac-56b5-42b0-b1ee-8d6537db65d8 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:52.018861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-09ca9cac-56b5-42b0-b1ee-8d6537db65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:52.106328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1238/2467] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:17:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:52.129601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:52.131527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:52.275879 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01d416-6518-4bce-9d8e-b17b84acb9e5 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:52.287835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:52.288421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:52.288686 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:52.289366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:52.329490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:52.331256 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:52.341738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1230/2468] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:17:52.937974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611f7a-700a-4f40-9439-b7deef8fe5c4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:52.938400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611f7a-700a-4f40-9439-b7deef8fe5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:52.938753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611f7a-700a-4f40-9439-b7deef8fe5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:52.962803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f3611f7a-700a-4f40-9439-b7deef8fe5c4 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:52.964055 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f3611f7a-700a-4f40-9439-b7deef8fe5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:52.972252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1239/2469] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 17 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:52.985009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:52.996852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7ed4f-5a94-46aa-b55c-70f660c6c4ab service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:53.002051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:53.002652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:53.002928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:53.003196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:53.011259 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:53.013489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:53.021331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1231/2470] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:17:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 16:17:53.266542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15877af-1ab4-49e5-b42f-d14afc22822f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:53.267036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15877af-1ab4-49e5-b42f-d14afc22822f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:53.267178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15877af-1ab4-49e5-b42f-d14afc22822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:53.287531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b15877af-1ab4-49e5-b42f-d14afc22822f None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:53.288785 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b15877af-1ab4-49e5-b42f-d14afc22822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:53.297040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1240/2471] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:53.309790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:53.321125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf16711-65d5-4d70-975f-2e3de45fb68c service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:53.326149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:53.326748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:53.327034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:53.327307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:53.335884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:53.337459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:53.346283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1232/2472] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:17:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:17:53.685879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:53.686172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:53.686452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:53.705155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:53.706361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:53.713429 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1241/2473] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 17 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:53.725768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:53.736727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780eb91-b660-4b15-a490-95adfbb9fb8e service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:53.741677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d562b-d3c9-4b35-91f7-de89f2131873 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:53.742267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d562b-d3c9-4b35-91f7-de89f2131873 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:53.742544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d562b-d3c9-4b35-91f7-de89f2131873 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:53.742815 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d562b-d3c9-4b35-91f7-de89f2131873 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:53.751314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d562b-d3c9-4b35-91f7-de89f2131873 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:53.752915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d562b-d3c9-4b35-91f7-de89f2131873 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:53.760797 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1233/2474] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:17:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:17:56.982700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:56.984182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:57.088306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131159bd-22e3-4cf9-b63a-e5171a6660ba None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:57.099610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:57.102056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:57.102444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:57.102893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] PATH_INFO: `/v3/users/faff5534c95e49e18f14d69654fb4996` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:57.104955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] RBAC: Authorizing `identity:delete_user(user_id=faff5534c95e49e18f14d69654fb4996)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:57.109273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:57.112843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:57.170299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faff5534c95e49e18f14d69654fb4996'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.170952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faff5534c95e49e18f14d69654fb4996'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.171548 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faff5534c95e49e18f14d69654fb4996'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.184703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faff5534c95e49e18f14d69654fb4996'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.191709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faff5534c95e49e18f14d69654fb4996'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.206310 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1242/2475] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:17:56 2022] DELETE /identity/v3/users/faff5534c95e49e18f14d69654fb4996 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:57.210906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:57.211369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:57.211643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:57.225736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:57.232756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:57.234732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:57.298524 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1234/2476] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:57.309214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:57.311111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:57.386255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4b46d-ba4c-4ae2-b514-c5703daaddff admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:57.392656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bcde6-63c3-4470-abd3-c081216b260c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:57.393366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bcde6-63c3-4470-abd3-c081216b260c service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:57.394976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bcde6-63c3-4470-abd3-c081216b260c service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:57.395257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bcde6-63c3-4470-abd3-c081216b260c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:57.405677 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bcde6-63c3-4470-abd3-c081216b260c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:57.407222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bcde6-63c3-4470-abd3-c081216b260c service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:57.421801 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1243/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:57.736158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:57.738370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:57.780842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685291f-2c8d-49ec-9e22-5bb210aeed27 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:57.787502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:57.788266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:57.788627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:57.789072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] PATH_INFO: `/v3/projects/e49ba29c576d4a40a591668c4c304aab` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:57.791632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49ba29c576d4a40a591668c4c304aab)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:57.794982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:57.881727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49ba29c576d4a40a591668c4c304aab', 'request_id': 'req-a5be74b6-60d1-4440-90ac-04e8a4acecae'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.888552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49ba29c576d4a40a591668c4c304aab', 'request_id': 'req-a5be74b6-60d1-4440-90ac-04e8a4acecae'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.901245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49ba29c576d4a40a591668c4c304aab', 'request_id': 'req-a5be74b6-60d1-4440-90ac-04e8a4acecae'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.917356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] The token cache is being invalidate because project e49ba29c576d4a40a591668c4c304aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:17:57.917696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.918642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a5be74b6-60d1-4440-90ac-04e8a4acecae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:17:57.920349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1235/2478] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:17:57 2022] DELETE /identity/v3/projects/e49ba29c576d4a40a591668c4c304aab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:17:57.925680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04125aee-6b11-4930-b681-5aa34ec4ce71 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:57.925680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04125aee-6b11-4930-b681-5aa34ec4ce71 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:57.925680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04125aee-6b11-4930-b681-5aa34ec4ce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:57.947085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-04125aee-6b11-4930-b681-5aa34ec4ce71 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:57.948327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-04125aee-6b11-4930-b681-5aa34ec4ce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:58.009743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1244/2479] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:17:58.018909 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9a1cd-b41a-4d4a-868b-2b1c067e3b23 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.019226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9a1cd-b41a-4d4a-868b-2b1c067e3b23 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.019537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9a1cd-b41a-4d4a-868b-2b1c067e3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.045316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-18b9a1cd-b41a-4d4a-868b-2b1c067e3b23 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:58.047880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-18b9a1cd-b41a-4d4a-868b-2b1c067e3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:58.059474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1236/2480] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:58.063466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04125aee-6b11-4930-b681-5aa34ec4ce71 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:58.075203 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04125aee-6b11-4930-b681-5aa34ec4ce71 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.080212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.080823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.081110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.081384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.082317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:17:58.082474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.084114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.098301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1245/2481] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:17:58.103016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9a1cd-b41a-4d4a-868b-2b1c067e3b23 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:58.113129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9a1cd-b41a-4d4a-868b-2b1c067e3b23 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.118547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.119224 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.119509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.119787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.120445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.123044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.153787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1237/2482] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:17:58 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:17:58.157950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:58.169098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be544927-d039-4e0e-9ecf-dcb7dd62ec67 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.177793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:58.240666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.241290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.241578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.241856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.242570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.244695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.271345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1246/2483] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:17:58 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:17:58.272573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:58.283677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8c856-e426-4477-bc3c-723d312607bf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.288387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.288990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.289270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.289543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.290190 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.291971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.304084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1238/2484] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:17:58.308001 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:58.318742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb006b-8faf-475f-8732-34a5e7f0ef02 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.325334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa660476-6d93-4993-8e4b-cdae2f83ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.326074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa660476-6d93-4993-8e4b-cdae2f83ced9 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.326415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa660476-6d93-4993-8e4b-cdae2f83ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.326727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa660476-6d93-4993-8e4b-cdae2f83ced9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.327516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa660476-6d93-4993-8e4b-cdae2f83ced9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.329465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa660476-6d93-4993-8e4b-cdae2f83ced9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.340692 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1247/2485] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:17:58.345011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:58.356023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9620-2d24-4d9b-80b5-3e6950ff29d3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.361774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.362493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.362788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.363069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] PATH_INFO: `/v3/projects/e7d8ebf3a2564588b603e8eaae8453da/users/39365b85268f4a5e9006cf6198e84f22/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.385926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d8ebf3a2564588b603e8eaae8453da, user_id=39365b85268f4a5e9006cf6198e84f22, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.389590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.405382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1239/2486] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:17:58 2022] PUT /identity/v3/projects/e7d8ebf3a2564588b603e8eaae8453da/users/39365b85268f4a5e9006cf6198e84f22/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:17:58.415945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.416561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.416973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.453864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] MFA Rules not processed for user `39365b85268f4a5e9006cf6198e84f22`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:58.455084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:58.519186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1248/2487] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:58.531874 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:58.533532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:58.565047 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:58.594141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c61a2-e4b6-43ea-9dee-418e2f41ab86 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:58.597716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:58.598327 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:58.598609 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:58.599195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:58.609769 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:58.611270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:58.620287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1240/2488] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:07.333833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:07.335373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:07.403856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1b15-264f-48d1-aa0b-15c5b982da12 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:07.408453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:07.409124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:07.409401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:07.409699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] PATH_INFO: `/v3/users/30eecb52931f48888c9369506d6ec580` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:07.410852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=30eecb52931f48888c9369506d6ec580)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:07.412955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:07.436555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:07.472864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30eecb52931f48888c9369506d6ec580'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.472864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30eecb52931f48888c9369506d6ec580'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.472864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30eecb52931f48888c9369506d6ec580'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.474307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:07.489316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30eecb52931f48888c9369506d6ec580'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.491317 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd7b1-57a8-4279-a8db-0c8b6fd3ad6b service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:07.500116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:07.501030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:07.501530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:07.501650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-19398032-1bc3-47d4-a465-10c08ecb70eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30eecb52931f48888c9369506d6ec580'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.502149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] PATH_INFO: `/v3/users/39365b85268f4a5e9006cf6198e84f22` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:07.503520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39365b85268f4a5e9006cf6198e84f22)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:07.505937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:07.529260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1249/2489] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:18:07 2022] DELETE /identity/v3/users/30eecb52931f48888c9369506d6ec580 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:18:07.531988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:07.532283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:07.532563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:07.570067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:07.571415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:07.576759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39365b85268f4a5e9006cf6198e84f22'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.601366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39365b85268f4a5e9006cf6198e84f22'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.602332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39365b85268f4a5e9006cf6198e84f22'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.616975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39365b85268f4a5e9006cf6198e84f22'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.628208 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-92fcbd95-f49c-40f1-affd-8bbdb9c73874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39365b85268f4a5e9006cf6198e84f22'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:07.635771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1241/2490] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:18:07 2022] DELETE /identity/v3/users/39365b85268f4a5e9006cf6198e84f22 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:07.641035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409a08-d366-4c59-a0fa-d95a8d065b7f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:07.641314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409a08-d366-4c59-a0fa-d95a8d065b7f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:07.641682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409a08-d366-4c59-a0fa-d95a8d065b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:07.644079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1250/2491] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:18:07.658994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:07.661181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:07.673003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ce409a08-d366-4c59-a0fa-d95a8d065b7f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:07.674342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ce409a08-d366-4c59-a0fa-d95a8d065b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:07.728444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57475f-7c8e-4b10-8e0f-b7f36d9bfc4b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:07.751487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1242/2492] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:18:07.763614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409a08-d366-4c59-a0fa-d95a8d065b7f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:07.785844 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:07.786597 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:07.786882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:07.787155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:07.797137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:07.798573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:07.802759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:07.813096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1251/2493] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:18:07.820972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:07.837666 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409a08-d366-4c59-a0fa-d95a8d065b7f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:07.842842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:07.843158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:07.843433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:07.843704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:07.854284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:07.855820 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:07.866405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1243/2494] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:08.390741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:08.392407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:08.415476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60103e6d-a181-40c0-91f2-c04fa0cc324b service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:08.422772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:08.422772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:08.423005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:08.423206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] PATH_INFO: `/v3/projects/bba421626bae441fbdf6536ed2bcb512` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:08.425718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba421626bae441fbdf6536ed2bcb512)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:08.427783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:08.442328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:08.445854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:08.477375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29052a0b-d259-4568-a646-c8dd74b4e51e service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:08.490865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697731-aa13-4356-b46c-588282604771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:08.491533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697731-aa13-4356-b46c-588282604771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:08.491840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697731-aa13-4356-b46c-588282604771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:08.493693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697731-aa13-4356-b46c-588282604771 admin admin] PATH_INFO: `/v3/projects/e7d8ebf3a2564588b603e8eaae8453da` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:08.497662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697731-aa13-4356-b46c-588282604771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d8ebf3a2564588b603e8eaae8453da)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:08.499596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697731-aa13-4356-b46c-588282604771 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:08.558883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba421626bae441fbdf6536ed2bcb512', 'request_id': 'req-9ca6a3c5-16f6-400d-a540-5b8586d691c5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.568647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba421626bae441fbdf6536ed2bcb512', 'request_id': 'req-9ca6a3c5-16f6-400d-a540-5b8586d691c5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.579993 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba421626bae441fbdf6536ed2bcb512', 'request_id': 'req-9ca6a3c5-16f6-400d-a540-5b8586d691c5'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.594662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] The token cache is being invalidate because project bba421626bae441fbdf6536ed2bcb512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:18:08.595000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.595782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9ca6a3c5-16f6-400d-a540-5b8586d691c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.596924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-df697731-aa13-4356-b46c-588282604771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d8ebf3a2564588b603e8eaae8453da', 'request_id': 'req-df697731-aa13-4356-b46c-588282604771'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.597948 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1252/2495] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:18:08 2022] DELETE /identity/v3/projects/bba421626bae441fbdf6536ed2bcb512 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:08.617170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-df697731-aa13-4356-b46c-588282604771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d8ebf3a2564588b603e8eaae8453da', 'request_id': 'req-df697731-aa13-4356-b46c-588282604771'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.641581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-df697731-aa13-4356-b46c-588282604771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d8ebf3a2564588b603e8eaae8453da', 'request_id': 'req-df697731-aa13-4356-b46c-588282604771'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.681368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-df697731-aa13-4356-b46c-588282604771 admin admin] The token cache is being invalidate because project e7d8ebf3a2564588b603e8eaae8453da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:18:08.682058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-df697731-aa13-4356-b46c-588282604771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.683550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-df697731-aa13-4356-b46c-588282604771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:08.691468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a32da-faca-493c-b3f8-bc34a0dccf71 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:08.691760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a32da-faca-493c-b3f8-bc34a0dccf71 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:08.692078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a32da-faca-493c-b3f8-bc34a0dccf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:08.706203 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1244/2496] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:18:08 2022] DELETE /identity/v3/projects/e7d8ebf3a2564588b603e8eaae8453da => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:08.799031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-807a32da-faca-493c-b3f8-bc34a0dccf71 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:08.801320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-807a32da-faca-493c-b3f8-bc34a0dccf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:08.902960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:08.903873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:08.904367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:08.905553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1253/2497] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:08.914957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516577-033f-4b0c-9093-531f0b15e6ab None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:08.915248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516577-033f-4b0c-9093-531f0b15e6ab None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:08.915753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516577-033f-4b0c-9093-531f0b15e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:08.941052 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:08.942695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:08.943273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-50516577-033f-4b0c-9093-531f0b15e6ab None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:08.944764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-50516577-033f-4b0c-9093-531f0b15e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:08.967158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1254/2498] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:18:08.969407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516577-033f-4b0c-9093-531f0b15e6ab None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:08.986994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516577-033f-4b0c-9093-531f0b15e6ab None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:08.993032 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:08.993823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:08.994175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:08.994540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:08.995300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:18:08.995678 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:08.998387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.018262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1255/2499] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:18:09.022610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:09.052696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa784a21-2d6b-47da-816f-9fbbb537ede2 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:09.062795 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:09.072254 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.072917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.073468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.074575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:09.077325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.084462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1245/2500] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:09.122821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:09.126891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:09.127049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1256/2501] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:18:09 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:18:09.128417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:09.193252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:09.220867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b7d7-a053-4307-9045-2f4d04d2e1a1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:09.240154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:09.243789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0260-65e4-4039-98f6-54dda617385f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:09.255538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:09.256278 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.256622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.256960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.257601 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:09.259769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.288071 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1257/2502] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:18:09 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:18:09.289427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:09.301178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d712-9fcb-492b-8293-749d421f160b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:09.306982 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:09.308186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.308186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.308186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.309793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:09.310973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.320699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:09.321672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.322110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.322557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.325632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1258/2503] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:18:09.326543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:09.339322 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786452-2593-48d9-9827-7d733aeba255 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:09.342417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:09.343133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.345568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.345843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.346941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:09.348240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.360120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1259/2504] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:18:09.364530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:09.377412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0278cc-8c57-45d6-b127-1ea910ed103a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:09.385539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a27d55-4959-40c4-ab4e-b10861a01e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:09.386000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a27d55-4959-40c4-ab4e-b10861a01e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.386343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a27d55-4959-40c4-ab4e-b10861a01e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.386563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a27d55-4959-40c4-ab4e-b10861a01e90 admin admin] PATH_INFO: `/v3/projects/c9eb10c3ae444a9c8472e9961a4ca79e/users/2f7f4cf57e814aebab32a56b19aa067f/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.410191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a27d55-4959-40c4-ab4e-b10861a01e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9eb10c3ae444a9c8472e9961a4ca79e, user_id=2f7f4cf57e814aebab32a56b19aa067f, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:09.412979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a27d55-4959-40c4-ab4e-b10861a01e90 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.427298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:09.428271 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1260/2505] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:18:09 2022] PUT /identity/v3/projects/c9eb10c3ae444a9c8472e9961a4ca79e/users/2f7f4cf57e814aebab32a56b19aa067f/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:09.431728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.433193 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5517dde-368d-40e0-8108-db80e09069c9 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.433479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5517dde-368d-40e0-8108-db80e09069c9 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.433815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5517dde-368d-40e0-8108-db80e09069c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.438223 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1246/2506] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:18:09.455098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b5517dde-368d-40e0-8108-db80e09069c9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:09.456740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b5517dde-368d-40e0-8108-db80e09069c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:09.602518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1261/2507] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:18:09.624856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:09.627007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:09.719641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cffe23-5316-4a73-83f4-001acaf26f84 service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:09.798676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff918d0-41c3-4bab-b6f4-0fd707beb665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:09.800021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff918d0-41c3-4bab-b6f4-0fd707beb665 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:09.800548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff918d0-41c3-4bab-b6f4-0fd707beb665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:09.800941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff918d0-41c3-4bab-b6f4-0fd707beb665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:09.848170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff918d0-41c3-4bab-b6f4-0fd707beb665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:09.849973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff918d0-41c3-4bab-b6f4-0fd707beb665 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:09.868122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1247/2508] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:11.364701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:11.365375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:11.365375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:11.406440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] MFA Rules not processed for user `f945c8c54cb14c0da00b647663278410`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:11.409636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:11.608171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1262/2509] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:18:17.359916 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3741c2-14f1-4de7-b625-eaa7ba32cc6f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:17.360451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3741c2-14f1-4de7-b625-eaa7ba32cc6f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:17.360543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3741c2-14f1-4de7-b625-eaa7ba32cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:17.449332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bd3741c2-14f1-4de7-b625-eaa7ba32cc6f None None] MFA Rules not processed for user `2f7f4cf57e814aebab32a56b19aa067f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:17.452161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bd3741c2-14f1-4de7-b625-eaa7ba32cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:17.457776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:17.461630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:17.463543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:17.495190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73922a-ed42-4c14-a50c-52c7fea36b49 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:17.510740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:17.512154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:17.512637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:17.513099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:17.515167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:17.584881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:17.623608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1248/2510] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:17.624628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3741c2-14f1-4de7-b625-eaa7ba32cc6f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:17.659992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3741c2-14f1-4de7-b625-eaa7ba32cc6f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:17.665620 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:17.666475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:17.666854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:17.667354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:17.668891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:17.670997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:17.685746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:17.687238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:17.707213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1263/2511] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:17.764684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:17.770707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1249/2512] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:18:17 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:18:17.779787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769002d-cc52-491a-95da-fdb6cf64464a service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:17.960742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:17.961481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:17.961833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:17.962182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:17.963721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:17.976331 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:18.047585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:18.055707 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1264/2513] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:18:17 2022] POST /identity/v3/users => generated 295 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:18:18.061430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4d24b-e527-4980-9f9b-dd94b11ff4fb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:18.076872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:18.077789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:18.078035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:18.078453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:18.081775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:18.086066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:18.139052 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:18.148599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1250/2514] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:18:18.156841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41c642-f156-463b-9a00-4780145b4da0 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:18.167191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:18.167543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:18.168706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:18.168863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] PATH_INFO: `/v3/projects/a663d697981c48e9a8b8cec80804fd63/users/d53258121ee44eb3b0ebf3eb25705288/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:18.212672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663d697981c48e9a8b8cec80804fd63, user_id=d53258121ee44eb3b0ebf3eb25705288, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:18.221556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:18.256847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1265/2515] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:18:18 2022] PUT /identity/v3/projects/a663d697981c48e9a8b8cec80804fd63/users/d53258121ee44eb3b0ebf3eb25705288/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:18.263390 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:18.287715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c2dc4-e864-4b73-baeb-738276d42bd5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:18.484275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099eaec-3169-4574-a6a7-39be31433686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:18.486188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099eaec-3169-4574-a6a7-39be31433686 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:18.488241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099eaec-3169-4574-a6a7-39be31433686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:18.488601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099eaec-3169-4574-a6a7-39be31433686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:18.490147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099eaec-3169-4574-a6a7-39be31433686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:18.496776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099eaec-3169-4574-a6a7-39be31433686 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:18.520922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1251/2516] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:18:18.525057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:18.549418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947713c-2063-4896-8968-6226690f38c8 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:18.563579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:18.564307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:18.564589 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:18.564871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] PATH_INFO: `/v3/projects/a663d697981c48e9a8b8cec80804fd63/users/d53258121ee44eb3b0ebf3eb25705288/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:18.573900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a663d697981c48e9a8b8cec80804fd63, user_id=d53258121ee44eb3b0ebf3eb25705288, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:18.578856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:18.644917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1266/2517] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:18:18 2022] PUT /identity/v3/projects/a663d697981c48e9a8b8cec80804fd63/users/d53258121ee44eb3b0ebf3eb25705288/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:22.597842 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127578bb-e9d9-49c5-b1db-a2ddf257e6d5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:22.600021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127578bb-e9d9-49c5-b1db-a2ddf257e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:22.601237 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127578bb-e9d9-49c5-b1db-a2ddf257e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:22.674656 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-127578bb-e9d9-49c5-b1db-a2ddf257e6d5 None None] MFA Rules not processed for user `9fe81a429dee4fba8708445dcefa293e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:22.679485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-127578bb-e9d9-49c5-b1db-a2ddf257e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:22.887505 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1252/2518] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:28.619351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:29.045145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:29.047044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:29.215888 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99de12-66a9-4aa8-9edc-128c3a8257fc admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:29.239918 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:29.242827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:29.243120 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:29.243403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] PATH_INFO: `/v3/users/dbc077590e514dbd837a1f6aaf65ac5f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:29.250080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc077590e514dbd837a1f6aaf65ac5f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:29.252206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:29.400108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc077590e514dbd837a1f6aaf65ac5f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:29.401103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc077590e514dbd837a1f6aaf65ac5f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:29.402746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc077590e514dbd837a1f6aaf65ac5f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:29.427781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc077590e514dbd837a1f6aaf65ac5f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:29.442417 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc077590e514dbd837a1f6aaf65ac5f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:29.474117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1267/2519] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:18:29 2022] DELETE /identity/v3/users/dbc077590e514dbd837a1f6aaf65ac5f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:29.478604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:29.479628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:29.480793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:29.510441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:29.512365 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:29.522961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:29.607167 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1253/2520] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:29.629959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:29.634056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:29.748683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ec4e0-af66-42a1-b8db-f589a5e97395 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:29.754281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93196dd-8170-4d8b-9341-76185bd4049d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:29.755343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93196dd-8170-4d8b-9341-76185bd4049d service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:29.756843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93196dd-8170-4d8b-9341-76185bd4049d service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:29.757132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93196dd-8170-4d8b-9341-76185bd4049d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:29.774168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93196dd-8170-4d8b-9341-76185bd4049d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:29.775639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93196dd-8170-4d8b-9341-76185bd4049d service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:29.790988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1268/2521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:31.175954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:31.178332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:31.207631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1b05b-f018-4f37-b6ff-c2f9b42553fe None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:31.218027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:31.218786 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.219308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.219906 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] PATH_INFO: `/v3/projects/1bdba0dc63f94a09848b1ef670c972f6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.222948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdba0dc63f94a09848b1ef670c972f6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:31.226877 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:31.298531 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdba0dc63f94a09848b1ef670c972f6', 'request_id': 'req-e048c04a-342e-4bfe-a2af-ece410b648cb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:31.305079 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdba0dc63f94a09848b1ef670c972f6', 'request_id': 'req-e048c04a-342e-4bfe-a2af-ece410b648cb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:31.315716 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdba0dc63f94a09848b1ef670c972f6', 'request_id': 'req-e048c04a-342e-4bfe-a2af-ece410b648cb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:31.342471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] The token cache is being invalidate because project 1bdba0dc63f94a09848b1ef670c972f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:18:31.342781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:31.343477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e048c04a-342e-4bfe-a2af-ece410b648cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:18:31.349149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1254/2522] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:18:31 2022] DELETE /identity/v3/projects/1bdba0dc63f94a09848b1ef670c972f6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:31.350605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a002f7c-3b4e-4f61-8647-4b26f2f3ccfc None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.351061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a002f7c-3b4e-4f61-8647-4b26f2f3ccfc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.351408 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a002f7c-3b4e-4f61-8647-4b26f2f3ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.394908 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5a002f7c-3b4e-4f61-8647-4b26f2f3ccfc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:31.396206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5a002f7c-3b4e-4f61-8647-4b26f2f3ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:31.421124 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:31.492825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1269/2523] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:18:31.501802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a82ca7-5c30-4601-a164-7cb58d72fdf5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.502097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a82ca7-5c30-4601-a164-7cb58d72fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.502361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a82ca7-5c30-4601-a164-7cb58d72fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.556369 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d3a82ca7-5c30-4601-a164-7cb58d72fdf5 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:31.557618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d3a82ca7-5c30-4601-a164-7cb58d72fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:31.580522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1255/2524] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:31.584468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a002f7c-3b4e-4f61-8647-4b26f2f3ccfc None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:31.598542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a002f7c-3b4e-4f61-8647-4b26f2f3ccfc None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:31.611324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:31.612694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.612694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.612694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.613373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:18:31.613682 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:31.615363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:31.632824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1270/2525] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:18:31.638558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a82ca7-5c30-4601-a164-7cb58d72fdf5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:31.650890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a82ca7-5c30-4601-a164-7cb58d72fdf5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:31.658801 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:31.659235 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.659677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.660084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.660776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:31.664826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:31.712775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1256/2526] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:18:31 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:18:31.716728 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:31.728979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104f718-3b24-45fd-970b-25080cc0bc14 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:31.838554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:31.838815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.839569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.839843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.840499 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:31.842449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:31.886947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:31.889068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1271/2527] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:18:31 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:18:31.902935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2927402-1357-4af5-9c0c-e84657526644 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:31.910792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:31.912018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.913132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.913652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.914400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:31.917767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:31.950981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1257/2528] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:18:31.954576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:31.968495 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c632bec-560d-4f5b-8215-c78e4bee529b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:31.977210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04541f7-a73e-4e29-8cd5-b988921ddc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:31.983553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04541f7-a73e-4e29-8cd5-b988921ddc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:31.983936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04541f7-a73e-4e29-8cd5-b988921ddc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:31.984188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04541f7-a73e-4e29-8cd5-b988921ddc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:31.984901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04541f7-a73e-4e29-8cd5-b988921ddc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:31.987442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04541f7-a73e-4e29-8cd5-b988921ddc04 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:32.005456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:32.014400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1272/2529] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:18:32.018836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d80c37-2a2a-43eb-a627-99d19edd7760 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:32.029259 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:32.031471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:32.031933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:32.032541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] PATH_INFO: `/v3/projects/28896a54086b475eacbbc8bd55e2edc1/users/4524f04719f54a1eb79e4590a86f8f92/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:32.055653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28896a54086b475eacbbc8bd55e2edc1, user_id=4524f04719f54a1eb79e4590a86f8f92, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:32.059063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:32.083863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1258/2530] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:18:32 2022] PUT /identity/v3/projects/28896a54086b475eacbbc8bd55e2edc1/users/4524f04719f54a1eb79e4590a86f8f92/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:18:32.088752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1a52-4441-4194-a981-9ebff0b92b98 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:32.089680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1a52-4441-4194-a981-9ebff0b92b98 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:32.089957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be1a52-4441-4194-a981-9ebff0b92b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:32.115642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-63be1a52-4441-4194-a981-9ebff0b92b98 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:32.117084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-63be1a52-4441-4194-a981-9ebff0b92b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:32.238968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1273/2531] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:18:32.304395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:32.306831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:32.379725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:32.422284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a48b1-1c3b-42ea-963d-8822c78e4703 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:32.433523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:32.434337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:32.434589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:32.434856 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:32.454084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:32.455973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:32.471643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1259/2532] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:33.086198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5b26-dbff-40f9-9562-061649184a27 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:33.086688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5b26-dbff-40f9-9562-061649184a27 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:33.087126 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b5b26-dbff-40f9-9562-061649184a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:33.142969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-228b5b26-dbff-40f9-9562-061649184a27 None None] MFA Rules not processed for user `d53258121ee44eb3b0ebf3eb25705288`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:33.144178 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-228b5b26-dbff-40f9-9562-061649184a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:33.166473 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:33.240033 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1274/2533] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:33.254489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:33.258135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:33.367042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36075f8-ce17-448a-a1a1-62ccf944d286 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:33.376276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:33.377286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:33.377760 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:33.378544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:33.381116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:33.451867 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:33.453395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:33.462852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1260/2534] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:33.709006 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e104a-cc11-42bc-9e2c-2c2175d3d848 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:33.709300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e104a-cc11-42bc-9e2c-2c2175d3d848 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:33.709584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e104a-cc11-42bc-9e2c-2c2175d3d848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:33.778129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-656e104a-cc11-42bc-9e2c-2c2175d3d848 None None] MFA Rules not processed for user `4524f04719f54a1eb79e4590a86f8f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:33.778129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-656e104a-cc11-42bc-9e2c-2c2175d3d848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:33.893311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1275/2535] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:33.905823 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:33.907417 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:33.999604 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbe915-ce84-43df-9487-7f120cdc6714 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:34.003257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fdf95-6f0a-43aa-b878-01a37e8ea3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:34.003922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdf95-6f0a-43aa-b878-01a37e8ea3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:34.004206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdf95-6f0a-43aa-b878-01a37e8ea3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:34.004484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdf95-6f0a-43aa-b878-01a37e8ea3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:34.015349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fdf95-6f0a-43aa-b878-01a37e8ea3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:34.018019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fdf95-6f0a-43aa-b878-01a37e8ea3b3 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:34.027645 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1261/2536] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:35.664111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2fbe-a510-4dca-9951-bb309ff071a5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:35.664621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2fbe-a510-4dca-9951-bb309ff071a5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:35.664723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2fbe-a510-4dca-9951-bb309ff071a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:35.695377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6e0d2fbe-a510-4dca-9951-bb309ff071a5 None None] MFA Rules not processed for user `4524f04719f54a1eb79e4590a86f8f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:35.695377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6e0d2fbe-a510-4dca-9951-bb309ff071a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:35.724827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1276/2537] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:37.689415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35d015-5f22-4d54-83e7-803b3a83febf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:37.690323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35d015-5f22-4d54-83e7-803b3a83febf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:37.690657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35d015-5f22-4d54-83e7-803b3a83febf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:37.692071 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1262/2538] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:37.703048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627fef-da9c-4995-999f-47c461496d33 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:37.703644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627fef-da9c-4995-999f-47c461496d33 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:37.703644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef627fef-da9c-4995-999f-47c461496d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:37.725491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ef627fef-da9c-4995-999f-47c461496d33 None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:37.726718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ef627fef-da9c-4995-999f-47c461496d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:37.736727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1277/2539] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:18:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:37.749035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35d015-5f22-4d54-83e7-803b3a83febf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:37.750750 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ae35d015-5f22-4d54-83e7-803b3a83febf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:37.771407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:37.835999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35d015-5f22-4d54-83e7-803b3a83febf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:37.852300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7ad9d-1f22-4fea-848e-322b82553144 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009c623055dc4defa2bd74a82c6a7e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:37.852300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ad9d-1f22-4fea-848e-322b82553144 service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:37.852300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ad9d-1f22-4fea-848e-322b82553144 service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:37.852300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7ad9d-1f22-4fea-848e-322b82553144 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:37.858493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7ad9d-1f22-4fea-848e-322b82553144 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:37.860289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7ad9d-1f22-4fea-848e-322b82553144 service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:37.890063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1263/2540] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:18:37.996188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6583-bf40-4b00-bf08-ff5d4b0379fc None None] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:37.996790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6583-bf40-4b00-bf08-ff5d4b0379fc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:37.997285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6583-bf40-4b00-bf08-ff5d4b0379fc None None] PATH_INFO: `/` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:37.998976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1278/2541] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:18:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:38.004658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:38.005042 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:38.005396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:38.027781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae6583-bf40-4b00-bf08-ff5d4b0379fc None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:38.029713 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2eae6583-bf40-4b00-bf08-ff5d4b0379fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:38.031077 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] MFA Rules not processed for user `13729a757e1a4f95a957fedb84705960`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:38.033269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:38.041179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1264/2542] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:38.057177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:38.059346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:38.069845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db837b55-75e2-4b86-9ed0-8c97f515363b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:38.074283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4e847-9abe-4768-810b-66fd97195789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:38.074788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e847-9abe-4768-810b-66fd97195789 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:38.075064 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e847-9abe-4768-810b-66fd97195789 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:38.075926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4e847-9abe-4768-810b-66fd97195789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:38.082871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e847-9abe-4768-810b-66fd97195789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:38.084330 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4e847-9abe-4768-810b-66fd97195789 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:38.094332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1265/2543] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:18:38.131346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae6583-bf40-4b00-bf08-ff5d4b0379fc None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:38.138764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd319f3-86cf-4227-98f3-e62bab748bdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:38.139528 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd319f3-86cf-4227-98f3-e62bab748bdc service placement] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:38.139836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd319f3-86cf-4227-98f3-e62bab748bdc service placement] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:38.151441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd319f3-86cf-4227-98f3-e62bab748bdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:38.154325 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7fd319f3-86cf-4227-98f3-e62bab748bdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:38.168815 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd319f3-86cf-4227-98f3-e62bab748bdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:38.170650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd319f3-86cf-4227-98f3-e62bab748bdc service placement] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:38.188529 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1279/2544] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:18:38.202892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e8624-9100-4d1b-8bad-a7eb5a071e43 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:38.203250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e8624-9100-4d1b-8bad-a7eb5a071e43 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:38.203455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e8624-9100-4d1b-8bad-a7eb5a071e43 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:38.204843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1266/2545] 10.222.0.60 () {54 vars in 921 bytes} [Wed Aug 17 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:18:38.210445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814140-38e2-451e-ab1c-8174f2bdcc8c None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:38.210733 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814140-38e2-451e-ab1c-8174f2bdcc8c None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:38.211011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06814140-38e2-451e-ab1c-8174f2bdcc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:38.246162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-06814140-38e2-451e-ab1c-8174f2bdcc8c None None] MFA Rules not processed for user `352b7e4d311d491f8e665d4cf7e554b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:38.247532 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-06814140-38e2-451e-ab1c-8174f2bdcc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:38.257205 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1280/2546] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Aug 17 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:38.268213 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e8624-9100-4d1b-8bad-a7eb5a071e43 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:38.279988 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e8624-9100-4d1b-8bad-a7eb5a071e43 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:38.290734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:38.291124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:38.291412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:38.291688 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:38.303533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:38.305538 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:38.321232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1267/2547] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:18:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:18:47.266425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcc04-a4b7-438a-93ed-175af059666d None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:47.266901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcc04-a4b7-438a-93ed-175af059666d None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:47.267168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcc04-a4b7-438a-93ed-175af059666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:47.287952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2cbfcc04-a4b7-438a-93ed-175af059666d None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:47.289273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2cbfcc04-a4b7-438a-93ed-175af059666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:47.299231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=100 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:18:47.349064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1281/2548] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:18:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:47.361671 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:47.362959 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:47.433468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3fe64-6687-4cf0-9da3-5e06fb1a5834 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:47.438380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:47.438982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:47.439260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:47.439529 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:47.447250 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:47.449215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:47.457027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1268/2549] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:18:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:18:51.713328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59db2e-92b3-4033-9496-0e809d27c396 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:51.713927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59db2e-92b3-4033-9496-0e809d27c396 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:51.714173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59db2e-92b3-4033-9496-0e809d27c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:51.747757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5c59db2e-92b3-4033-9496-0e809d27c396 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:51.748892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5c59db2e-92b3-4033-9496-0e809d27c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:51.757570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1282/2550] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:18:51.770674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:18:51.782350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960bd47-913d-4ded-9af0-a65c8e5d1f8d service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:18:51.787735 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068a6eb-e7bb-439e-97dd-489e5230db3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:18:51.788375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a6eb-e7bb-439e-97dd-489e5230db3f service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:51.788657 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a6eb-e7bb-439e-97dd-489e5230db3f service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:51.788957 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068a6eb-e7bb-439e-97dd-489e5230db3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:51.799499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068a6eb-e7bb-439e-97dd-489e5230db3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:18:51.801127 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068a6eb-e7bb-439e-97dd-489e5230db3f service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:18:51.810715 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1269/2551] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:18:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:18:56.135287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c801b7a-4b68-41cf-89ed-ca8eb4eca955 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:18:56.137147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c801b7a-4b68-41cf-89ed-ca8eb4eca955 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:18:56.137619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c801b7a-4b68-41cf-89ed-ca8eb4eca955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:18:56.165525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-9c801b7a-4b68-41cf-89ed-ca8eb4eca955 None None] MFA Rules not processed for user `2f7f4cf57e814aebab32a56b19aa067f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:18:56.168236 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9c801b7a-4b68-41cf-89ed-ca8eb4eca955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:18:56.183248 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1283/2552] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:01.813214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=72 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:06.157926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=25 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:14.193661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e4c7-d9f6-40e4-a86a-b78e00b26c55 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:14.194184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e4c7-d9f6-40e4-a86a-b78e00b26c55 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:14.194184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e4c7-d9f6-40e4-a86a-b78e00b26c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:14.214728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9d59e4c7-d9f6-40e4-a86a-b78e00b26c55 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:14.215960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9d59e4c7-d9f6-40e4-a86a-b78e00b26c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:14.223449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1270/2553] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 17 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:14.236210 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c801b7a-4b68-41cf-89ed-ca8eb4eca955 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:14.249003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c801b7a-4b68-41cf-89ed-ca8eb4eca955 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:14.254015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:14.254630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:14.254915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:14.255195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:14.264317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:14.265905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:14.274837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1284/2554] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:19:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:19:15.600301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:15.600775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:15.600886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:15.620240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:15.621742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:15.630848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1271/2555] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 17 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:15.643598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:15.655593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c608c1-7e7d-43ce-a13c-c85c4f6aeea6 service swift] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:15.664229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:15.664858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:15.665144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:15.666488 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:15.680645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:15.683341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:15.692103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1285/2556] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:19:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:19:16.406483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:16.408298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:16.433244 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3fb78-ea4d-48f9-a71b-73418089cb84 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:16.437915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:16.438622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:16.438997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:16.439341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] PATH_INFO: `/v3/users/f945c8c54cb14c0da00b647663278410` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:16.440576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f945c8c54cb14c0da00b647663278410)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:16.442711 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:16.518949 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f945c8c54cb14c0da00b647663278410'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.535184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f945c8c54cb14c0da00b647663278410'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.536032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f945c8c54cb14c0da00b647663278410'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.550016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f945c8c54cb14c0da00b647663278410'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.561575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fa10d618-6362-45ce-a452-8ad7fe353ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f945c8c54cb14c0da00b647663278410'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.572790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1272/2557] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:19:16 2022] DELETE /identity/v3/users/f945c8c54cb14c0da00b647663278410 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:19:16.756836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:16.774837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aab0e2-003c-47ed-a722-dcb9c291e5b2 service swift] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:16.854773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:16.855443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:16.855966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:16.856251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] PATH_INFO: `/v3/projects/07cd27d906cc4496bdeaf929ff4ec21e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:16.857537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07cd27d906cc4496bdeaf929ff4ec21e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:16.859540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:16.929214 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07cd27d906cc4496bdeaf929ff4ec21e', 'request_id': 'req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.936446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07cd27d906cc4496bdeaf929ff4ec21e', 'request_id': 'req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.944596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07cd27d906cc4496bdeaf929ff4ec21e', 'request_id': 'req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.956941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] The token cache is being invalidate because project 07cd27d906cc4496bdeaf929ff4ec21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:19:16.957235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.958061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-18f59d8b-e12f-4d26-a9e2-ef894fa6f0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:16.959565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1286/2558] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:19:16 2022] DELETE /identity/v3/projects/07cd27d906cc4496bdeaf929ff4ec21e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:19:16.964929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0aec-ecc0-4bab-ae90-b5574bb4c57a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:16.965426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0aec-ecc0-4bab-ae90-b5574bb4c57a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:16.965542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f0aec-ecc0-4bab-ae90-b5574bb4c57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:16.988100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a58f0aec-ecc0-4bab-ae90-b5574bb4c57a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:16.989371 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a58f0aec-ecc0-4bab-ae90-b5574bb4c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:17.061997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1273/2559] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:17.069355 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76120b2-ea59-4c8d-b21c-770f2f26af70 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.069768 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76120b2-ea59-4c8d-b21c-770f2f26af70 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.070058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76120b2-ea59-4c8d-b21c-770f2f26af70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.092800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f76120b2-ea59-4c8d-b21c-770f2f26af70 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:17.094043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f76120b2-ea59-4c8d-b21c-770f2f26af70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:17.102293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1287/2560] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:17.106890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f0aec-ecc0-4bab-ae90-b5574bb4c57a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:17.117196 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f0aec-ecc0-4bab-ae90-b5574bb4c57a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:17.122825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:17.123445 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.123727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.124044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.124853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:19:17.125165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:17.126781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:17.139615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1274/2561] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:19:17.144510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76120b2-ea59-4c8d-b21c-770f2f26af70 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:17.160646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76120b2-ea59-4c8d-b21c-770f2f26af70 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:17.166756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:17.167632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.168051 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.168506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.169687 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:17.171894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:17.200093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1288/2562] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:19:17 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:19:17.204568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:17.215448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd87a9-2a1a-4dc0-9b67-2065d7961e0a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:17.265550 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:17.281612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:17.282347 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.282687 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.283024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.283853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:17.285972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:17.311882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1275/2563] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:19:17 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:19:17.313385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:17.325885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849dc2e-4f1f-4883-bf98-f774f16be3e9 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:17.330891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:17.331748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.332245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.332591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.333307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:17.334984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:17.346789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1289/2564] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:19:17.351652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:17.364429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9b7e7-8399-4c2d-a383-e91317d21bad admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:17.369997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b7124-7872-49bc-8c98-89c9665ef2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:17.370607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b7124-7872-49bc-8c98-89c9665ef2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.370939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b7124-7872-49bc-8c98-89c9665ef2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.371230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b7124-7872-49bc-8c98-89c9665ef2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.372144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b7124-7872-49bc-8c98-89c9665ef2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:17.373911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b7124-7872-49bc-8c98-89c9665ef2c2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:17.388128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1276/2565] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:19:17.390845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:17.402089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfc146-d84f-4ff2-86c1-fc60882637c2 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:17.406971 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:17.407625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.407939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.408215 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] PATH_INFO: `/v3/projects/6e78d9c87ecc44d582245b2d3b8111c6/users/f0facf9cf99949c09e772ddc7e346ab2/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.424362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e78d9c87ecc44d582245b2d3b8111c6, user_id=f0facf9cf99949c09e772ddc7e346ab2, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:17.427084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:17.436881 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:17.444393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1290/2566] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:19:17 2022] PUT /identity/v3/projects/6e78d9c87ecc44d582245b2d3b8111c6/users/f0facf9cf99949c09e772ddc7e346ab2/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:19:17.456155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.456588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.456862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.485843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] MFA Rules not processed for user `f0facf9cf99949c09e772ddc7e346ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:17.487054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:17.556832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1277/2567] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:19:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:17.569300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:17.571102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:17.636260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb6550-7418-4cc8-9278-44f276525b45 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:17.639960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009c623055dc4defa2bd74a82c6a7e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:17.640565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:17.640847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:17.641121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:17.649662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:17.651128 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:17.660298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1291/2568] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:19:19.962961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:19.964491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:20.023633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8aae2-97f8-4927-8a34-ef0706adb257 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:20.027376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f8174-8b95-40d0-abc1-f847b0d21d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:20.028018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f8174-8b95-40d0-abc1-f847b0d21d55 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:20.028301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f8174-8b95-40d0-abc1-f847b0d21d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:20.028577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f8174-8b95-40d0-abc1-f847b0d21d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:20.030302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d41f8174-8b95-40d0-abc1-f847b0d21d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:20.097226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f8174-8b95-40d0-abc1-f847b0d21d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:20.098930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f8174-8b95-40d0-abc1-f847b0d21d55 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:20.109081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1278/2569] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:19:27.656176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=26 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:30.104674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:57.135340 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:57.199181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61cd5f-9861-4b44-a9bb-8410da20dbcb service glance] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:57.203797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:57.204447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:57.204732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:57.205011 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] PATH_INFO: `/v3/users/f0facf9cf99949c09e772ddc7e346ab2` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.206131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0facf9cf99949c09e772ddc7e346ab2)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:57.208088 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:57.256498 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0facf9cf99949c09e772ddc7e346ab2'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.257182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0facf9cf99949c09e772ddc7e346ab2'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.257805 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0facf9cf99949c09e772ddc7e346ab2'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.269764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0facf9cf99949c09e772ddc7e346ab2'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.277336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0facf9cf99949c09e772ddc7e346ab2'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.289921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1292/2570] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:19:57 2022] DELETE /identity/v3/users/f0facf9cf99949c09e772ddc7e346ab2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:19:57.295084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:57.295563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:57.295661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.314570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:57.315779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:57.374266 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1279/2571] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:57.384066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:57.385984 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:57.442506 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08d77c-841b-40b0-b11d-ea5b1b7b837f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:57.446370 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ecbe4-54df-41f3-bde5-508c85d2abf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:57.446964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ecbe4-54df-41f3-bde5-508c85d2abf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:57.447242 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ecbe4-54df-41f3-bde5-508c85d2abf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:57.448187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ecbe4-54df-41f3-bde5-508c85d2abf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.457131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ecbe4-54df-41f3-bde5-508c85d2abf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:57.458571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ecbe4-54df-41f3-bde5-508c85d2abf3 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:57.469132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1293/2572] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:19:57.740348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:57.741768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:57.754563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257ec19-cba4-4714-afdf-72d25571c84f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:57.761346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:57.762021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:57.762341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:57.762620 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] PATH_INFO: `/v3/projects/6e78d9c87ecc44d582245b2d3b8111c6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:57.763778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e78d9c87ecc44d582245b2d3b8111c6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:57.766943 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:57.817056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e78d9c87ecc44d582245b2d3b8111c6', 'request_id': 'req-0983ba11-e744-4609-931e-925dcd373d38'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.823238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e78d9c87ecc44d582245b2d3b8111c6', 'request_id': 'req-0983ba11-e744-4609-931e-925dcd373d38'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.830935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e78d9c87ecc44d582245b2d3b8111c6', 'request_id': 'req-0983ba11-e744-4609-931e-925dcd373d38'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.843157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] The token cache is being invalidate because project 6e78d9c87ecc44d582245b2d3b8111c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:19:57.843459 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.844132 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0983ba11-e744-4609-931e-925dcd373d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:19:57.845633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1280/2573] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:19:57 2022] DELETE /identity/v3/projects/6e78d9c87ecc44d582245b2d3b8111c6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:20:07.464989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:07.840117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:13.348446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:13.349015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:13.349015 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:13.367718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] MFA Rules not processed for user `4524f04719f54a1eb79e4590a86f8f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:20:13.368955 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:13.424746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1294/2574] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:20:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:20:19.544542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:19.545065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:19.545065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:19.563710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] MFA Rules not processed for user `9fe81a429dee4fba8708445dcefa293e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:20:19.564947 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:19.620166 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1281/2575] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:20:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:20:23.417797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=25 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:25.742209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:25.743671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:25.818823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f72978-c4e2-4cb3-8c1e-873b9f1ed683 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:25.826584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d5dc-18a9-4ecc-94ef-b2ef1c22700b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:25.826584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d5dc-18a9-4ecc-94ef-b2ef1c22700b service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:25.826584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d5dc-18a9-4ecc-94ef-b2ef1c22700b service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:25.826584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d5dc-18a9-4ecc-94ef-b2ef1c22700b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:25.828610 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a2b9d5dc-18a9-4ecc-94ef-b2ef1c22700b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:25.918302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d5dc-18a9-4ecc-94ef-b2ef1c22700b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:25.920478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d5dc-18a9-4ecc-94ef-b2ef1c22700b service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:25.936172 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1295/2576] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:29.613521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=25 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:29.862974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:29.864440 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:29.923663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c2789-eda6-4697-9a80-03750e40c0cf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:29.927283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:29.927929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:29.928231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:29.928511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:29.930312 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:29.946510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:29.948578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:29.961522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1282/2577] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:35.647939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a744f1b-4187-4b03-bc5e-8381343f919f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:35.648461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a744f1b-4187-4b03-bc5e-8381343f919f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:35.648461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a744f1b-4187-4b03-bc5e-8381343f919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:35.669129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-8a744f1b-4187-4b03-bc5e-8381343f919f None None] MFA Rules not processed for user `79729883ac964badae04665e547634da`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:20:35.670390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8a744f1b-4187-4b03-bc5e-8381343f919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:35.725341 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1296/2578] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:20:37.419639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:37.421076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:37.435422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6763c1-3779-4c97-b1ab-bcb8119f7372 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:37.440922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:37.441509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:37.441791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:37.442067 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:37.443752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:37.454653 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:37.456301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:37.465238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1283/2579] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:45.718435 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=79 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:47.461090 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=32 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:49.351083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95f86-2a86-40db-b65c-d3f2ad2b6416 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:49.351569 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95f86-2a86-40db-b65c-d3f2ad2b6416 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:49.351670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a95f86-2a86-40db-b65c-d3f2ad2b6416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:49.373073 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-87a95f86-2a86-40db-b65c-d3f2ad2b6416 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:20:49.374401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-87a95f86-2a86-40db-b65c-d3f2ad2b6416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:49.432057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1297/2580] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 17 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:20:49.487033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:49.488814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:49.561936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74c096-6704-48fa-978a-d142a54d6589 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:49.566985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:49.567589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:49.567902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:49.568179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:49.576214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:49.577773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:49.585714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1284/2581] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:20:51.166209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95f86-2a86-40db-b65c-d3f2ad2b6416 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:51.176902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a95f86-2a86-40db-b65c-d3f2ad2b6416 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:51.180988 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:51.182150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:51.182432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:51.182702 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:51.184684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:51.194890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:51.196645 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:51.206770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1298/2582] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:54.570972 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:54.584238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c3aea-5aed-453f-822d-763dee899f72 service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:54.592290 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:54.593163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:54.593617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:54.593881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:54.595914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:54.611884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:54.613841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:54.627378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1285/2583] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:57.719954 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:57.721529 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:57.794800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc3c38-004d-4bb4-a105-d1b2779180f9 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:57.799441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:57.800134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:57.800412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:57.800688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] PATH_INFO: `/v3/users/388379cb8722477fbba3162dcbe3cc8a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:57.801837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388379cb8722477fbba3162dcbe3cc8a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:57.803775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:57.859794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388379cb8722477fbba3162dcbe3cc8a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:57.860476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388379cb8722477fbba3162dcbe3cc8a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:57.861078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388379cb8722477fbba3162dcbe3cc8a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:57.873485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388379cb8722477fbba3162dcbe3cc8a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:57.880410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388379cb8722477fbba3162dcbe3cc8a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:57.893624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1299/2584] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:20:57 2022] DELETE /identity/v3/users/388379cb8722477fbba3162dcbe3cc8a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:20:58.065271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:58.078799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f4b94-3a54-42f4-9090-a09ad31bae59 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:58.144859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a908-5227-4605-8397-36197d386905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:58.145530 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a908-5227-4605-8397-36197d386905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:58.145818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a908-5227-4605-8397-36197d386905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:58.146098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118a908-5227-4605-8397-36197d386905 admin admin] PATH_INFO: `/v3/projects/c73a224fc7784fd6876e81a0e7097127` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:58.147220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a908-5227-4605-8397-36197d386905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73a224fc7784fd6876e81a0e7097127)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:58.149206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118a908-5227-4605-8397-36197d386905 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:58.195412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73a224fc7784fd6876e81a0e7097127', 'request_id': 'req-3118a908-5227-4605-8397-36197d386905'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.201138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73a224fc7784fd6876e81a0e7097127', 'request_id': 'req-3118a908-5227-4605-8397-36197d386905'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.208210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73a224fc7784fd6876e81a0e7097127', 'request_id': 'req-3118a908-5227-4605-8397-36197d386905'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.219363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3118a908-5227-4605-8397-36197d386905 admin admin] The token cache is being invalidate because project c73a224fc7784fd6876e81a0e7097127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:20:58.219757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.220453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.222487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1286/2585] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:20:58 2022] DELETE /identity/v3/projects/c73a224fc7784fd6876e81a0e7097127 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:20:58.226478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:58.227960 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:58.243053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818005d-1fb7-4161-8f54-cd948d1b5436 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:58.257226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:58.309037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:58.309620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:58.309956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:58.310239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] PATH_INFO: `/v3/users/6a6bf9baf4174876b40923cb5cbc6a34` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:58.311390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6bf9baf4174876b40923cb5cbc6a34)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:58.313385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:58.362942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6bf9baf4174876b40923cb5cbc6a34'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.363255 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6bf9baf4174876b40923cb5cbc6a34'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.363964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6bf9baf4174876b40923cb5cbc6a34'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.377188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6bf9baf4174876b40923cb5cbc6a34'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.384316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6bf9baf4174876b40923cb5cbc6a34'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.398100 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1300/2586] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:20:58 2022] DELETE /identity/v3/users/6a6bf9baf4174876b40923cb5cbc6a34 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:20:58.578477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:58.580018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:20:58.594265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118a908-5227-4605-8397-36197d386905 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:58.598549 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:58.659088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:58.659730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:58.660122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:58.660358 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] PATH_INFO: `/v3/projects/84eaf954cdfd46abac824354fd9b0e2b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:58.661880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84eaf954cdfd46abac824354fd9b0e2b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:58.663783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:58.715987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84eaf954cdfd46abac824354fd9b0e2b', 'request_id': 'req-0e734523-a451-43c0-b993-1ae99d36580e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.722479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84eaf954cdfd46abac824354fd9b0e2b', 'request_id': 'req-0e734523-a451-43c0-b993-1ae99d36580e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.729882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84eaf954cdfd46abac824354fd9b0e2b', 'request_id': 'req-0e734523-a451-43c0-b993-1ae99d36580e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.744888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] The token cache is being invalidate because project 84eaf954cdfd46abac824354fd9b0e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:20:58.745314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.745953 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:20:58.747471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1287/2587] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:20:58 2022] DELETE /identity/v3/projects/84eaf954cdfd46abac824354fd9b0e2b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:06.608116 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:06.609531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:06.667922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929a8cd-36f8-438b-a3bd-255d54593202 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:06.713101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:06.720871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:06.721734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:06.722342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:06.722717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:06.724746 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:06.785450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:06.786896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:06.796957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1301/2588] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:08.740983 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:13.148442 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:13.150986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:13.239258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e734523-a451-43c0-b993-1ae99d36580e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:13.246702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:13.247342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:13.247764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:13.248142 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:13.250676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:13.264830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:13.266454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:13.279504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1288/2589] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:16.755263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:16.756852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:16.823987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55610-7800-4669-b694-6727d822abc8 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:16.828579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:16.829150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:16.829431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:16.829734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] PATH_INFO: `/v3/users/4524f04719f54a1eb79e4590a86f8f92` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:16.830861 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4524f04719f54a1eb79e4590a86f8f92)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:16.832880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:16.879153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4524f04719f54a1eb79e4590a86f8f92'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:16.879827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4524f04719f54a1eb79e4590a86f8f92'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:16.880468 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4524f04719f54a1eb79e4590a86f8f92'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:16.892256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4524f04719f54a1eb79e4590a86f8f92'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:16.898977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4524f04719f54a1eb79e4590a86f8f92'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:16.911727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1302/2590] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:21:16 2022] DELETE /identity/v3/users/4524f04719f54a1eb79e4590a86f8f92 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:17.087008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:17.098387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad312ab3-5d89-43b0-9266-7b0932415dee service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:17.156307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:17.157019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:17.157368 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:17.157714 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] PATH_INFO: `/v3/projects/28896a54086b475eacbbc8bd55e2edc1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:17.158899 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28896a54086b475eacbbc8bd55e2edc1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:17.161265 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:17.210980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28896a54086b475eacbbc8bd55e2edc1', 'request_id': 'req-bcd1d26d-1a8d-447d-8c31-631e8f151e71'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:17.217475 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28896a54086b475eacbbc8bd55e2edc1', 'request_id': 'req-bcd1d26d-1a8d-447d-8c31-631e8f151e71'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:17.225164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28896a54086b475eacbbc8bd55e2edc1', 'request_id': 'req-bcd1d26d-1a8d-447d-8c31-631e8f151e71'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:17.236831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] The token cache is being invalidate because project 28896a54086b475eacbbc8bd55e2edc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:21:17.237125 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:17.237770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:17.239264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1289/2591] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:21:17 2022] DELETE /identity/v3/projects/28896a54086b475eacbbc8bd55e2edc1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:25.774084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:25.776632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:25.798115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:25.838388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02840c75-03c5-41c8-8be1-2f9298185fae admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:25.887886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:25.888491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:25.888771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:25.889043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:25.890914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:25.952520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:25.953952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:25.963629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1303/2592] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:27.233761 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:29.108642 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.110126 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:29.125747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1d26d-1a8d-447d-8c31-631e8f151e71 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.130573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.131210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.131487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.131759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] PATH_INFO: `/v3/users/9fe81a429dee4fba8708445dcefa293e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.132929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe81a429dee4fba8708445dcefa293e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.135523 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.182350 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe81a429dee4fba8708445dcefa293e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.189491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe81a429dee4fba8708445dcefa293e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.190189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe81a429dee4fba8708445dcefa293e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.202841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe81a429dee4fba8708445dcefa293e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.210109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb884d33-42b1-4ae8-95e1-4817281b7d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe81a429dee4fba8708445dcefa293e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.216621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1290/2593] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:21:29 2022] DELETE /identity/v3/users/9fe81a429dee4fba8708445dcefa293e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:29.389007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.401855 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed26bd-4715-4ca5-987f-ba3d134f4d1b service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.458312 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.458941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.459219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.459832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] PATH_INFO: `/v3/projects/34b7fa307d994f2792503e6761f3c079` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.460942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b7fa307d994f2792503e6761f3c079)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.463952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.495913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:29.511884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b7fa307d994f2792503e6761f3c079', 'request_id': 'req-8ea84598-8a7e-4713-9b6f-53cc57049efa'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.517327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b7fa307d994f2792503e6761f3c079', 'request_id': 'req-8ea84598-8a7e-4713-9b6f-53cc57049efa'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.523741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b7fa307d994f2792503e6761f3c079', 'request_id': 'req-8ea84598-8a7e-4713-9b6f-53cc57049efa'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.543020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] The token cache is being invalidate because project 34b7fa307d994f2792503e6761f3c079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:21:29.543304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.543989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-8ea84598-8a7e-4713-9b6f-53cc57049efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:29.545524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1304/2594] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:21:29 2022] DELETE /identity/v3/projects/34b7fa307d994f2792503e6761f3c079 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:29.550568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b8fa-cec3-431f-b802-f3458b558f2e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.550854 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b8fa-cec3-431f-b802-f3458b558f2e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.551135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b8fa-cec3-431f-b802-f3458b558f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.570840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-19e6b8fa-cec3-431f-b802-f3458b558f2e None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:29.572743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-19e6b8fa-cec3-431f-b802-f3458b558f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:29.632103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1291/2595] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:29.640608 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afcf74-294c-4a4e-b017-777d3ca4e98f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.640893 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afcf74-294c-4a4e-b017-777d3ca4e98f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.641167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afcf74-294c-4a4e-b017-777d3ca4e98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.660317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d8afcf74-294c-4a4e-b017-777d3ca4e98f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:29.661518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d8afcf74-294c-4a4e-b017-777d3ca4e98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:29.669554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1305/2596] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:29.673828 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6b8fa-cec3-431f-b802-f3458b558f2e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.683985 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6b8fa-cec3-431f-b802-f3458b558f2e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.688495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.689084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.689360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.689631 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.690361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:21:29.690785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.692396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.704309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1292/2597] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:21:29.708650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afcf74-294c-4a4e-b017-777d3ca4e98f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.718013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afcf74-294c-4a4e-b017-777d3ca4e98f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.722944 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.723540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.723916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.724198 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.724814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.726710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.753966 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1306/2598] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:21:29 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:21:29.758005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.768678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc366-020e-4305-a129-7db7bd577f4a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.825611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.826222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.826504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.826775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.827405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.829340 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.837374 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:29.852898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1293/2599] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:21:29 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:21:29.857040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.867445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ae7cd-1587-42d2-a0b1-cff6b72abae7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.873000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.873611 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.873894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.874169 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.874816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.876475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.887274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1307/2600] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:21:29.891099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.901066 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b28ddf-efe6-4be9-89d5-260df80831cd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.905680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5de570-c2c3-4d34-acbc-72f99fa807e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.906275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de570-c2c3-4d34-acbc-72f99fa807e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.906560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de570-c2c3-4d34-acbc-72f99fa807e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.906837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5de570-c2c3-4d34-acbc-72f99fa807e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.907548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de570-c2c3-4d34-acbc-72f99fa807e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.909108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5de570-c2c3-4d34-acbc-72f99fa807e2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.920304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1294/2601] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:21:29.924442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:29.935327 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246649c-0418-46da-9a96-2d6ad4f1213b admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:29.940017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:29.940667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.940950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.941227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] PATH_INFO: `/v3/projects/70e2e41d5730457a93725abb31d0a672/users/b7f7896e070541c18b391ff71320bc9a/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.956021 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e2e41d5730457a93725abb31d0a672, user_id=b7f7896e070541c18b391ff71320bc9a, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:29.958749 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:29.972698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1308/2602] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:21:29 2022] PUT /identity/v3/projects/70e2e41d5730457a93725abb31d0a672/users/b7f7896e070541c18b391ff71320bc9a/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:29.977455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835101a0-80db-4ca6-b5d5-328839fa602a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:29.977914 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835101a0-80db-4ca6-b5d5-328839fa602a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:29.978232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835101a0-80db-4ca6-b5d5-328839fa602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:29.997112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-835101a0-80db-4ca6-b5d5-328839fa602a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:29.998336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-835101a0-80db-4ca6-b5d5-328839fa602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:30.062692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1295/2603] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:30.072882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:30.074591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:30.132216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f11c70-1a05-42e9-97da-1ce097a66a12 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:30.136440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:30.137044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:30.137376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:30.137600 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:30.146508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:30.148013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:30.158192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1309/2604] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:34.188603 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7154ea-66ea-4e0b-867e-46dd63399e00 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:34.189151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7154ea-66ea-4e0b-867e-46dd63399e00 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:34.189151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7154ea-66ea-4e0b-867e-46dd63399e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:34.225504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6a7154ea-66ea-4e0b-867e-46dd63399e00 None None] MFA Rules not processed for user `b7f7896e070541c18b391ff71320bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:34.226727 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6a7154ea-66ea-4e0b-867e-46dd63399e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:34.307965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1296/2605] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:34.325045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:34.327279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:34.389896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:34.423079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf850051-11e6-474d-8668-a1d57c208490 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:34.431294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:34.431680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:34.432103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:34.432481 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:34.447766 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:34.449605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:34.458873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1310/2606] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:36.076328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:36.076818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:36.076935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:36.097408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] MFA Rules not processed for user `b7f7896e070541c18b391ff71320bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:36.098637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:36.105719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1297/2607] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:21:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:36.452756 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:36.464385 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8380a2-9048-496e-96a4-00d4d2da3f39 service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:36.469287 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:36.469903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:36.470187 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:36.470461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:36.472863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:36.484025 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:36.485415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:36.495717 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1311/2608] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:36.845803 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:36.847471 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:36.931881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:36.937473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf19eb-bb6f-488f-b5c3-7cbfd881fd4b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:36.947890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd730b68-0a8a-4180-98df-981f69bf6629 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:36.948633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730b68-0a8a-4180-98df-981f69bf6629 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:36.948973 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730b68-0a8a-4180-98df-981f69bf6629 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:36.949287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd730b68-0a8a-4180-98df-981f69bf6629 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:36.951395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dd730b68-0a8a-4180-98df-981f69bf6629 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:36.964567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd730b68-0a8a-4180-98df-981f69bf6629 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:36.966195 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd730b68-0a8a-4180-98df-981f69bf6629 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:36.976790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1298/2609] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:21:45.106083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:45.108857 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:45.128649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e97311-77f5-4565-8901-4a289a9d6928 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:45.135839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647450de-3365-4ff9-b2bf-ddf6678528f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:45.136781 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647450de-3365-4ff9-b2bf-ddf6678528f5 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:45.137371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647450de-3365-4ff9-b2bf-ddf6678528f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:45.137657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647450de-3365-4ff9-b2bf-ddf6678528f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:45.139544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-647450de-3365-4ff9-b2bf-ddf6678528f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:45.155761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647450de-3365-4ff9-b2bf-ddf6678528f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:45.157763 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647450de-3365-4ff9-b2bf-ddf6678528f5 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:45.169688 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1312/2610] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:46.972380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:48.223276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:48.223886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:48.223886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:48.243710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] MFA Rules not processed for user `2f7f4cf57e814aebab32a56b19aa067f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:48.244944 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:48.305216 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1299/2611] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:21:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:21:55.164154 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=21 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:58.298381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=25 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:59.599590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852774f-89f7-4d2c-a0eb-de22c971f4eb None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:59.600113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852774f-89f7-4d2c-a0eb-de22c971f4eb None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:59.600209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852774f-89f7-4d2c-a0eb-de22c971f4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:59.620423 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-4852774f-89f7-4d2c-a0eb-de22c971f4eb None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:59.621650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4852774f-89f7-4d2c-a0eb-de22c971f4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:59.676526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1313/2612] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:21:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:59.724149 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:59.725554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:59.797428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c88f7-d4d6-447b-a293-3e32742c768d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:59.802498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:59.803464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:59.803464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:59.803629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:59.812035 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:59.813682 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:59.822322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1300/2613] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:22:09.669724 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=25 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:09.819065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=32 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:15.704240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2d10-3c01-45ad-9bd3-181f847041cd None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:15.704710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2d10-3c01-45ad-9bd3-181f847041cd None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:15.704811 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac2d10-3c01-45ad-9bd3-181f847041cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:15.725465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-a9ac2d10-3c01-45ad-9bd3-181f847041cd None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:22:15.726599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-a9ac2d10-3c01-45ad-9bd3-181f847041cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:15.734458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1314/2614] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Aug 17 16:22:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:22:15.746827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:22:15.757489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb635-58fd-40c6-a4d4-5715b5981645 service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:22:15.762814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:22:15.763412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:15.763698 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:15.764004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:15.772204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:22:15.773764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:22:15.782005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1301/2615] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:22:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:22:25.718738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:25.779421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:27.117003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5731d0-3b2a-44ba-ad0a-3f292d3af592 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:27.117555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5731d0-3b2a-44ba-ad0a-3f292d3af592 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:27.117555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5731d0-3b2a-44ba-ad0a-3f292d3af592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:27.138714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-db5731d0-3b2a-44ba-ad0a-3f292d3af592 None None] MFA Rules not processed for user `36e0031b7d51472d8580f4897c9c420f`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:22:27.139991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-db5731d0-3b2a-44ba-ad0a-3f292d3af592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:27.147356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1315/2616] 10.222.0.60 () {58 vars in 967 bytes} [Wed Aug 17 16:22:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:22:27.160305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:22:27.171591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f575205-7e5d-492d-9788-e0f6146b3aaa service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:22:27.176670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52a56e6519a04ac297ef8f2e1094157f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:22:27.177279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:27.177553 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:27.177836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:27.186289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:22:27.187911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:22:27.196308 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1302/2617] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Aug 17 16:22:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 16:22:37.133018 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:37.192919 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:13.248863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5731d0-3b2a-44ba-ad0a-3f292d3af592 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:13.259251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5731d0-3b2a-44ba-ad0a-3f292d3af592 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:13.263127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:13.263867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:13.264216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:13.264615 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:13.266834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:13.279096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:13.280596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:13.290290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1316/2618] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:16.324821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:16.339587 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c0e47-e23f-470b-86a5-5dc301cc49ed service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:16.349439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:16.350088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:16.350429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:16.350772 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:16.354920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:16.376422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:16.378018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:16.399546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1303/2619] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:16.418803 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:16.421180 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:16.434261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d95b1a-b371-4bbb-ad6f-3cbdf0b475e2 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:16.442997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:16.443836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:16.444130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:16.444744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] PATH_INFO: `/v3/users/79729883ac964badae04665e547634da` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:16.446298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79729883ac964badae04665e547634da)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:16.448639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:16.500240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79729883ac964badae04665e547634da'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.500915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79729883ac964badae04665e547634da'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.501516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79729883ac964badae04665e547634da'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.513816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79729883ac964badae04665e547634da'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.521303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1b83fae6-b834-426f-90bf-07fac0498e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79729883ac964badae04665e547634da'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.534137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1317/2620] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:23:16 2022] DELETE /identity/v3/users/79729883ac964badae04665e547634da => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:16.709346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:16.720884 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d44fa9-9c4f-4aff-a4e5-7aa06b404134 service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:16.780663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:16.781303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:16.781615 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:16.781894 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] PATH_INFO: `/v3/projects/d23a63f9104b44ff9afa19fc00dbbd37` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:16.783029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23a63f9104b44ff9afa19fc00dbbd37)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:16.784977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:16.831976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23a63f9104b44ff9afa19fc00dbbd37', 'request_id': 'req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.837674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23a63f9104b44ff9afa19fc00dbbd37', 'request_id': 'req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.845878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23a63f9104b44ff9afa19fc00dbbd37', 'request_id': 'req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.857129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] The token cache is being invalidate because project d23a63f9104b44ff9afa19fc00dbbd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:23:16.857434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.858043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0a7ec2e-bb28-498f-a688-1a8516a05ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:23:16.860114 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1304/2621] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:23:16 2022] DELETE /identity/v3/projects/d23a63f9104b44ff9afa19fc00dbbd37 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:16.865192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c3e7-a3d6-4d68-bd66-14ba9959c697 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:16.865485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c3e7-a3d6-4d68-bd66-14ba9959c697 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:16.865764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73c3e7-a3d6-4d68-bd66-14ba9959c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:16.887879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1b73c3e7-a3d6-4d68-bd66-14ba9959c697 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:16.889082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1b73c3e7-a3d6-4d68-bd66-14ba9959c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:16.954680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1318/2622] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:16.962611 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298722-a21b-4083-9cbd-70dc7e83cbb9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:16.962901 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298722-a21b-4083-9cbd-70dc7e83cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:16.963178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8298722-a21b-4083-9cbd-70dc7e83cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:16.982979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a8298722-a21b-4083-9cbd-70dc7e83cbb9 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:16.984779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a8298722-a21b-4083-9cbd-70dc7e83cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:16.992598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1305/2623] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:23:16.996776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73c3e7-a3d6-4d68-bd66-14ba9959c697 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:17.007324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73c3e7-a3d6-4d68-bd66-14ba9959c697 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:17.012097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:17.012727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.013005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.013274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.013917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:23:17.014218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:17.016040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:17.027523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1319/2624] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:23:17.031738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8298722-a21b-4083-9cbd-70dc7e83cbb9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:17.040904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8298722-a21b-4083-9cbd-70dc7e83cbb9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:17.045522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:17.046650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.047108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.047479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.048170 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:17.050060 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:17.076979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1306/2625] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:23:17 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:17.080991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:17.090932 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c322d-5e5d-4cb3-8646-84681815c601 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:17.134767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:17.149133 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:17.149673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.149950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.150221 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.150833 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:17.152892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:17.174461 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1320/2626] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:23:17 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:23:17.178591 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:17.189605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f64e6-93e1-4ca5-9984-c0ac25caa275 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:17.194143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:17.194744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.195024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.195296 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.195967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:17.197578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:17.207575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1307/2627] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:17.211431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:17.222023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d6c27-0dd7-40fa-af50-845ce6d81571 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:17.226792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d3939-5679-46f9-b6b6-3c338527a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:17.227405 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3939-5679-46f9-b6b6-3c338527a68b admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.227684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3939-5679-46f9-b6b6-3c338527a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.227999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3939-5679-46f9-b6b6-3c338527a68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.228642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d3939-5679-46f9-b6b6-3c338527a68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:17.230220 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d3939-5679-46f9-b6b6-3c338527a68b admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:17.241596 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1321/2628] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:23:17.245590 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:17.255780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd01178-6b51-404d-a480-dcecbc33b4b4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:17.260323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:17.260961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.261238 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.261507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] PATH_INFO: `/v3/projects/c0011ec6367f43859c048642b2c324a1/users/efaa552d402646b28f2f52068558fce0/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.276392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0011ec6367f43859c048642b2c324a1, user_id=efaa552d402646b28f2f52068558fce0, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:17.279012 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:17.292462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1308/2629] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:23:17 2022] PUT /identity/v3/projects/c0011ec6367f43859c048642b2c324a1/users/efaa552d402646b28f2f52068558fce0/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:23:17.297558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258ffd-a14b-4707-9c5a-050e6e623f95 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.297875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258ffd-a14b-4707-9c5a-050e6e623f95 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.298155 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258ffd-a14b-4707-9c5a-050e6e623f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.318044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-99258ffd-a14b-4707-9c5a-050e6e623f95 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:17.319275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-99258ffd-a14b-4707-9c5a-050e6e623f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:17.377957 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1322/2630] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:23:17.387500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:17.389181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:17.404160 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:17.450246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1169684-c6f6-4ecd-9e11-1ca895b8ba0f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:17.454593 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:17.455201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:17.455483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:17.455759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:17.464799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:17.466222 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:17.475968 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1309/2631] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:23:21.460797 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a53a5-5ba4-4fec-a225-f3b119c59679 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:21.461229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a53a5-5ba4-4fec-a225-f3b119c59679 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:21.461229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a53a5-5ba4-4fec-a225-f3b119c59679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:21.496237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6a8a53a5-5ba4-4fec-a225-f3b119c59679 None None] MFA Rules not processed for user `efaa552d402646b28f2f52068558fce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:21.497482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6a8a53a5-5ba4-4fec-a225-f3b119c59679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:21.568421 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1323/2632] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:21.583697 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:21.585302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:21.665651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94d09-1e75-4058-857b-fb4934fdff6c service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:21.671831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:21.672467 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:21.672749 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:21.673029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:21.681851 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:21.683447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:21.693863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1310/2633] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:22.965838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:22.966342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:22.966441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:22.986206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] MFA Rules not processed for user `efaa552d402646b28f2f52068558fce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:22.987431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:22.994332 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1324/2634] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:31.689372 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=54 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:32.980397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:37.976817 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:37.978335 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:38.121183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:23:38.122644 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:38.126150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcf0e2-727c-4e1b-8ec1-31a6e4a8a8ad service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:38.132291 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c47041-aec0-4e67-8e80-02fb2e51fbb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:38.133148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47041-aec0-4e67-8e80-02fb2e51fbb9 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:38.133588 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47041-aec0-4e67-8e80-02fb2e51fbb9 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:38.133866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c47041-aec0-4e67-8e80-02fb2e51fbb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:38.135621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b8c47041-aec0-4e67-8e80-02fb2e51fbb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:38.147934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47041-aec0-4e67-8e80-02fb2e51fbb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:38.149498 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c47041-aec0-4e67-8e80-02fb2e51fbb9 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:38.160753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1311/2635] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:23:38.194748 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac0623-edaf-4a31-b73a-5a409d6c4aa5 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:23:38.198570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab18fee-648b-4960-8b48-3709540a1217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:23:38.199182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18fee-648b-4960-8b48-3709540a1217 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:38.199459 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18fee-648b-4960-8b48-3709540a1217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:38.199729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18fee-648b-4960-8b48-3709540a1217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:38.202094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2ab18fee-648b-4960-8b48-3709540a1217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:38.262496 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab18fee-648b-4960-8b48-3709540a1217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:23:38.264540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab18fee-648b-4960-8b48-3709540a1217 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:23:38.273576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1325/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:23:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:23:45.140375 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123449b5-bf03-4aca-baee-97efd2aa794c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:23:45.140888 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123449b5-bf03-4aca-baee-97efd2aa794c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:23:45.140990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123449b5-bf03-4aca-baee-97efd2aa794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:23:45.159573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-123449b5-bf03-4aca-baee-97efd2aa794c None None] MFA Rules not processed for user `2f7f4cf57e814aebab32a56b19aa067f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:23:45.160795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-123449b5-bf03-4aca-baee-97efd2aa794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:23:45.167492 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1312/2637] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:23:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:23:48.269502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=54 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:23:55.154262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=66 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:20.942354 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a12e-5f28-439d-b293-cb69a7512894 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:20.942880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a12e-5f28-439d-b293-cb69a7512894 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:20.942880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a12e-5f28-439d-b293-cb69a7512894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:20.961926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2f17a12e-5f28-439d-b293-cb69a7512894 None None] MFA Rules not processed for user `efaa552d402646b28f2f52068558fce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:20.963162 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2f17a12e-5f28-439d-b293-cb69a7512894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:20.970772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1326/2638] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:24:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:30.956552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:41.040860 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:41.041393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:41.041393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:41.060951 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] MFA Rules not processed for user `b7f7896e070541c18b391ff71320bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:24:41.062140 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:41.117344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1313/2639] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:24:51.110573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=25 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:21.023511 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c529-46c4-4cf8-aefb-6673c19d56b4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:21.024103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c529-46c4-4cf8-aefb-6673c19d56b4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:21.024103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c529-46c4-4cf8-aefb-6673c19d56b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:21.043243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-91d5c529-46c4-4cf8-aefb-6673c19d56b4 None None] MFA Rules not processed for user `efaa552d402646b28f2f52068558fce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:25:21.044787 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-91d5c529-46c4-4cf8-aefb-6673c19d56b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:21.051622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1327/2640] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:25:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:25:26.237419 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:26.238746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:26.272423 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf3f89-8982-40c3-bd2a-f8d021f84b64 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:26.275979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:26.276573 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:26.276857 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:26.277128 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:26.279598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:26.435080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:26.436580 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:26.456705 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1314/2641] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:31.038151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:31.156230 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c529-46c4-4cf8-aefb-6673c19d56b4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:31.168891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c529-46c4-4cf8-aefb-6673c19d56b4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:31.173050 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:31.173667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:31.173956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:31.174231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:31.176028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:31.189562 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:31.191009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:31.202751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1328/2642] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:25:36.453981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=27 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:41.197159 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=6 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:25:51.879824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:51.892451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd504cd-7294-488b-a854-fe4a6616fbcf service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:51.899273 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:51.900384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:51.900798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:51.901246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:51.903133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:51.932649 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:51.941676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:51.955710 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1315/2643] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:56.118321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:56.120709 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:56.148931 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c841c-589d-40c3-a883-db083900fb28 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:56.156013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:56.158427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:56.159146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:56.159686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:56.163646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:56.180806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:56.182695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:25:56.213144 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1329/2644] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:25:59.945309 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:25:59.953840 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b724dd2-5c64-4677-bcd7-bc99046c6b45 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:25:59.958353 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:25:59.958941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:25:59.959214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:25:59.959479 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:25:59.961239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:25:59.995439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:25:59.996875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:00.016065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1316/2645] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:06.190508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=6 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:06.763838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:06.765540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:06.791883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc51a1c-d04f-4b9f-95b5-863d96d37f4b service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:06.804533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:06.805686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:06.806131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:06.806586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] PATH_INFO: `/v3/users/b7f7896e070541c18b391ff71320bc9a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:06.808229 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f7896e070541c18b391ff71320bc9a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:06.810672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:06.930665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f7896e070541c18b391ff71320bc9a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:06.931721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f7896e070541c18b391ff71320bc9a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:06.932604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f7896e070541c18b391ff71320bc9a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:06.957517 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f7896e070541c18b391ff71320bc9a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:06.970251 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f7896e070541c18b391ff71320bc9a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:06.990626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1330/2646] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:06 2022] DELETE /identity/v3/users/b7f7896e070541c18b391ff71320bc9a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:07.364124 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.372100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e134532-ecd1-452a-9a8d-f2cdcc209299 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.396008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.399263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:07.473992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.474978 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.475311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.475670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] PATH_INFO: `/v3/projects/70e2e41d5730457a93725abb31d0a672` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.481755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e2e41d5730457a93725abb31d0a672)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.484622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:07.503895 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bce710-75cc-4af1-aa8e-6a4f66d24dda admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.509474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.509783 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.510066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.510344 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.512224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:07.527212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.529108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:07.540633 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1331/2647] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:26:07.541540 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.543014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:07.552647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e2e41d5730457a93725abb31d0a672', 'request_id': 'req-3453e081-79d8-49bd-86ca-e63baee06bac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.560170 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00e785-a99f-405e-8f60-d35b4fd6b786 service placement] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.561855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e2e41d5730457a93725abb31d0a672', 'request_id': 'req-3453e081-79d8-49bd-86ca-e63baee06bac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.571154 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e2e41d5730457a93725abb31d0a672', 'request_id': 'req-3453e081-79d8-49bd-86ca-e63baee06bac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.586281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] The token cache is being invalidate because project 70e2e41d5730457a93725abb31d0a672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:07.586574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.587231 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3453e081-79d8-49bd-86ca-e63baee06bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.588754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1317/2648] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:07 2022] DELETE /identity/v3/projects/70e2e41d5730457a93725abb31d0a672 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:07.593474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f009-6aec-43bb-8e86-35e744dbd79f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.593754 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f009-6aec-43bb-8e86-35e744dbd79f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.594301 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243f009-6aec-43bb-8e86-35e744dbd79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.621457 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.622098 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.622401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.622679 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] PATH_INFO: `/v3/users/2f7f4cf57e814aebab32a56b19aa067f` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.623865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7f4cf57e814aebab32a56b19aa067f)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.625782 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:07.628860 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:07.646143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:07.655481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8243f009-6aec-43bb-8e86-35e744dbd79f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:07.657689 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8243f009-6aec-43bb-8e86-35e744dbd79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:07.672074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1318/2649] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:07.679185 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7f4cf57e814aebab32a56b19aa067f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.679896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7f4cf57e814aebab32a56b19aa067f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.680531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7f4cf57e814aebab32a56b19aa067f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.681171 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9068a-0baf-47ab-841f-8a1b82a7f683 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.681581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9068a-0baf-47ab-841f-8a1b82a7f683 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.681728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9068a-0baf-47ab-841f-8a1b82a7f683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.692836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7f4cf57e814aebab32a56b19aa067f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.700309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7f4cf57e814aebab32a56b19aa067f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:07.700458 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6df9068a-0baf-47ab-841f-8a1b82a7f683 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:07.701540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6df9068a-0baf-47ab-841f-8a1b82a7f683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:07.710629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1319/2650] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:07.714743 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9068a-0baf-47ab-841f-8a1b82a7f683 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.716168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1332/2651] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:07 2022] DELETE /identity/v3/users/2f7f4cf57e814aebab32a56b19aa067f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:07.724991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9068a-0baf-47ab-841f-8a1b82a7f683 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.784895 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.785512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.785908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.786110 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.786848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:26:07.787740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.789363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:07.802997 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1320/2652] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:26:07.807440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.818204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636ece4-3f51-4f93-afaa-348c6e1f3579 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.823134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.823752 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.824072 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.824632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.824990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.826924 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:07.869864 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1333/2653] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:07 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:07.871063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.882096 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e443a80-5cac-4c1b-b7db-e880856bc489 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.901391 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.903183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:07.950619 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.951230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.951507 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.951866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.952493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.954370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:07.974849 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92dd07-ea38-4ba6-9f3e-dec3309bba23 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.977179 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1321/2654] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:07 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:07.979958 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.980602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.980887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.981164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] PATH_INFO: `/v3/projects/c9eb10c3ae444a9c8472e9961a4ca79e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.981276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:07.982292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9eb10c3ae444a9c8472e9961a4ca79e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.984234 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:07.991258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d108d3-ef0f-45e8-844c-7354d7e8e69c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:07.995908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:07.996509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:07.997297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:07.997297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:07.998003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:07.999629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.012756 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1322/2655] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:08.016728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.027733 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f80eb-a493-4f18-b2b0-035ec55e5d07 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.041769 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'request_id': 'req-00310a3a-6efd-47fc-ade8-f47bb95d00ea'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.043767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:08.048068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'request_id': 'req-00310a3a-6efd-47fc-ade8-f47bb95d00ea'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.058252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9eb10c3ae444a9c8472e9961a4ca79e', 'request_id': 'req-00310a3a-6efd-47fc-ade8-f47bb95d00ea'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.071560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] The token cache is being invalidate because project c9eb10c3ae444a9c8472e9961a4ca79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:08.071884 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.072581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.074104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1334/2656] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:07 2022] DELETE /identity/v3/projects/c9eb10c3ae444a9c8472e9961a4ca79e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:26:08.078440 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.079649 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.094401 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.095008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.095285 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.095554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.096400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.098027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.103359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:08.112381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1323/2657] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:26:08.113207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.114955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.128065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73789e76-7a34-4552-b108-c86ed63fbacf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.132767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d004-c02f-4a03-9733-be4276e2fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.133487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d004-c02f-4a03-9733-be4276e2fe8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.133709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d004-c02f-4a03-9733-be4276e2fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.133987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d004-c02f-4a03-9733-be4276e2fe8c admin admin] PATH_INFO: `/v3/projects/b4f3b12b73094c97b8caf8e0c4338060/users/8b13eddf479a45019df23e24764b7865/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.151712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142d004-c02f-4a03-9733-be4276e2fe8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f3b12b73094c97b8caf8e0c4338060, user_id=8b13eddf479a45019df23e24764b7865, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.152066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00310a3a-6efd-47fc-ade8-f47bb95d00ea admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.154601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142d004-c02f-4a03-9733-be4276e2fe8c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.156792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.157479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.157712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.157989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] PATH_INFO: `/v3/users/d53258121ee44eb3b0ebf3eb25705288` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.159722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53258121ee44eb3b0ebf3eb25705288)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.161925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.169173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1324/2658] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:08 2022] PUT /identity/v3/projects/b4f3b12b73094c97b8caf8e0c4338060/users/8b13eddf479a45019df23e24764b7865/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:26:08.180496 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.180783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.181063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.212157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] MFA Rules not processed for user `8b13eddf479a45019df23e24764b7865`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:08.213253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53258121ee44eb3b0ebf3eb25705288'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.213382 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.214237 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53258121ee44eb3b0ebf3eb25705288'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.214866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53258121ee44eb3b0ebf3eb25705288'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.227981 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53258121ee44eb3b0ebf3eb25705288'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.235192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53258121ee44eb3b0ebf3eb25705288'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.253516 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1335/2659] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:08 2022] DELETE /identity/v3/users/d53258121ee44eb3b0ebf3eb25705288 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:08.281038 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1325/2660] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:08.293627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.295219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.356896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:08.376529 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03636b-f2b6-46fd-ae2c-11ff8bcbbbf4 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.382317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.382940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.383253 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.383533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.444774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.446345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.459228 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.461096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.475206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1336/2661] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:08.545722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3e15-8f2d-41eb-b776-a7d87b2503da None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.625948 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.627388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.627944 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.628432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] PATH_INFO: `/v3/projects/a663d697981c48e9a8b8cec80804fd63` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.630407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a663d697981c48e9a8b8cec80804fd63)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.634164 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.662759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:08.717685 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a663d697981c48e9a8b8cec80804fd63', 'request_id': 'req-6db5bce3-56b4-4ba8-b077-e07d99c9c974'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.728243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a663d697981c48e9a8b8cec80804fd63', 'request_id': 'req-6db5bce3-56b4-4ba8-b077-e07d99c9c974'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.739541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a663d697981c48e9a8b8cec80804fd63', 'request_id': 'req-6db5bce3-56b4-4ba8-b077-e07d99c9c974'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.756819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] The token cache is being invalidate because project a663d697981c48e9a8b8cec80804fd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:08.756819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.760267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6db5bce3-56b4-4ba8-b077-e07d99c9c974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.761799 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1326/2662] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:08 2022] DELETE /identity/v3/projects/a663d697981c48e9a8b8cec80804fd63 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:08.766213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:08.766213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:08.780140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c6840-170b-4fb6-b140-151016655543 service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:08.859701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:08.860401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.860681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.860956 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] PATH_INFO: `/v3/users/8b13eddf479a45019df23e24764b7865` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.862188 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b13eddf479a45019df23e24764b7865)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:08.864192 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:08.918628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b13eddf479a45019df23e24764b7865'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.919592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b13eddf479a45019df23e24764b7865'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.920227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b13eddf479a45019df23e24764b7865'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.933903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b13eddf479a45019df23e24764b7865'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.941449 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b13eddf479a45019df23e24764b7865'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:08.956609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1337/2663] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:08 2022] DELETE /identity/v3/users/8b13eddf479a45019df23e24764b7865 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:08.961283 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:08.961563 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:08.961837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:08.982554 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:08.983866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:09.051791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1327/2664] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:09.062560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.068699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:09.097531 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:09.137741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a798240-c50a-42a5-ac91-c457abf81964 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.141373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea5397-56a9-4cc9-aedf-53a062e54d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.142059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5397-56a9-4cc9-aedf-53a062e54d00 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.142358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5397-56a9-4cc9-aedf-53a062e54d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.142714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5397-56a9-4cc9-aedf-53a062e54d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.152919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea5397-56a9-4cc9-aedf-53a062e54d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.154349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea5397-56a9-4cc9-aedf-53a062e54d00 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:09.163970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1338/2665] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:09.438850 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.440932 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:09.455367 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9f6ff-76fe-4f24-ace9-7dfe9fe85c4d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.460543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.461191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.461472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.461745 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] PATH_INFO: `/v3/projects/b4f3b12b73094c97b8caf8e0c4338060` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.462962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f3b12b73094c97b8caf8e0c4338060)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.464922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:09.514260 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f3b12b73094c97b8caf8e0c4338060', 'request_id': 'req-1166941b-dc4e-4324-9c2f-51c564f26c0d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:09.519933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f3b12b73094c97b8caf8e0c4338060', 'request_id': 'req-1166941b-dc4e-4324-9c2f-51c564f26c0d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:09.527512 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f3b12b73094c97b8caf8e0c4338060', 'request_id': 'req-1166941b-dc4e-4324-9c2f-51c564f26c0d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:09.539366 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] The token cache is being invalidate because project b4f3b12b73094c97b8caf8e0c4338060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:09.539662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:09.540348 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1166941b-dc4e-4324-9c2f-51c564f26c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:09.541832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1328/2666] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:09 2022] DELETE /identity/v3/projects/b4f3b12b73094c97b8caf8e0c4338060 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:09.546770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07be87-cfb9-45fa-b279-63c8aee1d7be None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.547321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07be87-cfb9-45fa-b279-63c8aee1d7be None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.547428 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07be87-cfb9-45fa-b279-63c8aee1d7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.567646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-ef07be87-cfb9-45fa-b279-63c8aee1d7be None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:09.568901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ef07be87-cfb9-45fa-b279-63c8aee1d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:09.630081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1339/2667] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:09.637955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15082-3b55-4ffb-bab6-a63ed3af0099 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.638241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15082-3b55-4ffb-bab6-a63ed3af0099 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.638514 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15082-3b55-4ffb-bab6-a63ed3af0099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.658429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-25c15082-3b55-4ffb-bab6-a63ed3af0099 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:09.660192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-25c15082-3b55-4ffb-bab6-a63ed3af0099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:09.668058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1329/2668] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:09.672425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07be87-cfb9-45fa-b279-63c8aee1d7be None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.683148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07be87-cfb9-45fa-b279-63c8aee1d7be None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.687742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.688383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.688666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.688941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.689593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:26:09.690017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.691622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:09.703537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1340/2669] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:26:09.708359 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c15082-3b55-4ffb-bab6-a63ed3af0099 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.724048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c15082-3b55-4ffb-bab6-a63ed3af0099 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.728835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.729447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.729730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.730002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.730643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.732579 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:09.754737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:09.767281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1330/2670] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:09 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:26:09.769371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.786878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248084f-a977-494b-aadf-5d70b02bf511 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.847362 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.848467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.848975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.849523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.850627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.854057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:09.883290 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1341/2671] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:09 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:09.884758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.896109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde93d1-74fa-44a0-8983-1c3c30883cb1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.900855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.901473 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.901742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.902015 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.902664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.904287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:09.915397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1331/2672] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:09.922491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.930515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aae1db-c616-46d2-8c93-3e71f714c95f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.935166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157cafc-deea-42d9-9ded-4e8bbb2f70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.935761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cafc-deea-42d9-9ded-4e8bbb2f70ff admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.936078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cafc-deea-42d9-9ded-4e8bbb2f70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.936350 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cafc-deea-42d9-9ded-4e8bbb2f70ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.936991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157cafc-deea-42d9-9ded-4e8bbb2f70ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.938578 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157cafc-deea-42d9-9ded-4e8bbb2f70ff admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:09.949755 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1342/2673] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:09.953935 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:09.964993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a35e-7714-415d-985d-4ee0c77b9dd5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:09.969976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:09.970636 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:09.970922 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:09.971785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] PATH_INFO: `/v3/projects/6d0722d71ca245acad0ecd8495620098/users/30e8f8986e164fb5a95514f8047112f0/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:09.989286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0722d71ca245acad0ecd8495620098, user_id=30e8f8986e164fb5a95514f8047112f0, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:09.991958 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.006709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1332/2674] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:09 2022] PUT /identity/v3/projects/6d0722d71ca245acad0ecd8495620098/users/30e8f8986e164fb5a95514f8047112f0/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:26:10.018779 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314e7ae-93e8-4a5f-b74a-2fef2e834914 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.019013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314e7ae-93e8-4a5f-b74a-2fef2e834914 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.019273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314e7ae-93e8-4a5f-b74a-2fef2e834914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.047520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e314e7ae-93e8-4a5f-b74a-2fef2e834914 None None] MFA Rules not processed for user `30e8f8986e164fb5a95514f8047112f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:10.049053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e314e7ae-93e8-4a5f-b74a-2fef2e834914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:10.062592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:10.127485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1343/2675] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:10.132108 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.209429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23676aea-145c-4d32-b78b-e6a2719b1b8d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.214098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.214707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.214987 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.215264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.215940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.217848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.245566 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1333/2676] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:10 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:26:10.249880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314e7ae-93e8-4a5f-b74a-2fef2e834914 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.260873 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314e7ae-93e8-4a5f-b74a-2fef2e834914 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.319206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.319725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.320036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.320311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.320946 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.322890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.344007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1344/2677] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:10 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:10.348441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.358522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbedad0-7cc4-41d7-8974-70f0d553cca1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.363177 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.363798 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.364105 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.364379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.365023 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.366598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.376767 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1334/2678] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:10.381455 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.391651 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef9bed-99a8-4b19-aa3f-f179cbe7c193 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.396939 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.397595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.397875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.398150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] PATH_INFO: `/v3/projects/00034bdb5a494d789e02265bbb84f5da/users/8abef8d5bfd0465d9f610aba3db00da3/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.413145 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00034bdb5a494d789e02265bbb84f5da, user_id=8abef8d5bfd0465d9f610aba3db00da3, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.415818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.430275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1345/2679] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:10 2022] PUT /identity/v3/projects/00034bdb5a494d789e02265bbb84f5da/users/8abef8d5bfd0465d9f610aba3db00da3/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:10.434269 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.444960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a320-8eff-490e-a37d-2c6f1d58df42 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.500980 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d4134-c1f6-4f9b-a900-c8d6c6486b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.501641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4134-c1f6-4f9b-a900-c8d6c6486b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.501844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4134-c1f6-4f9b-a900-c8d6c6486b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.502115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d4134-c1f6-4f9b-a900-c8d6c6486b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.503329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d4134-c1f6-4f9b-a900-c8d6c6486b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.504926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d4134-c1f6-4f9b-a900-c8d6c6486b74 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.514770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1335/2680] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:10.519538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.529811 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3f72f-0c5b-4ab8-9ec6-e49ce9db105c admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.534542 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.535189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.535471 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.535745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] PATH_INFO: `/v3/projects/00034bdb5a494d789e02265bbb84f5da/users/8abef8d5bfd0465d9f610aba3db00da3/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.537686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00034bdb5a494d789e02265bbb84f5da, user_id=8abef8d5bfd0465d9f610aba3db00da3, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.540450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.551258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1346/2681] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:10 2022] PUT /identity/v3/projects/00034bdb5a494d789e02265bbb84f5da/users/8abef8d5bfd0465d9f610aba3db00da3/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:10.561392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.561680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.561956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.591559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] MFA Rules not processed for user `8abef8d5bfd0465d9f610aba3db00da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:10.592724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:10.613345 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:10.662144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1336/2682] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:10.673115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.675509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:10.750698 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:10.755889 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b681f3e-ec5b-4018-bc5a-5aa4a96fab63 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.759899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.760512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.760793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.761069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.770045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.771487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.781023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1347/2683] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:10.834699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:10.836138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:10.848708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f127b-58f7-4f33-b658-7177f52a4a89 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:10.852198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe280b-62b1-4b6c-8e51-3040b327b81e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:10.852792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe280b-62b1-4b6c-8e51-3040b327b81e service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:10.853069 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe280b-62b1-4b6c-8e51-3040b327b81e service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:10.853338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe280b-62b1-4b6c-8e51-3040b327b81e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:10.913059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe280b-62b1-4b6c-8e51-3040b327b81e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:10.914508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe280b-62b1-4b6c-8e51-3040b327b81e service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:10.923845 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1337/2684] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:14.210104 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:14.273991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd03a8-bc4b-477f-98a2-f807c8984573 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:14.278432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:14.279082 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:14.279360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:14.279632 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] PATH_INFO: `/v3/users/30e8f8986e164fb5a95514f8047112f0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:14.280761 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e8f8986e164fb5a95514f8047112f0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:14.282660 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:14.328427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e8f8986e164fb5a95514f8047112f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.329005 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e8f8986e164fb5a95514f8047112f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.329613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e8f8986e164fb5a95514f8047112f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.341470 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e8f8986e164fb5a95514f8047112f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.349298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e8f8986e164fb5a95514f8047112f0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.362513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1348/2685] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:14 2022] DELETE /identity/v3/users/30e8f8986e164fb5a95514f8047112f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:14.367094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:14.367577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:14.367695 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:14.386302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:14.387488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:14.450900 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1338/2686] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:14.461121 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:14.462543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:14.520442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c78b34-267b-4597-8901-f05f524f1408 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:14.524134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:14.524767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:14.525043 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:14.525314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:14.534962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:14.536420 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:14.545666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1349/2687] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:14.822853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:14.828129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:14.837577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c21d-4b9a-4e15-958e-50aa788e6f0f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:14.845232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:14.846000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:14.846378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:14.846726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] PATH_INFO: `/v3/projects/6d0722d71ca245acad0ecd8495620098` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:14.847910 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0722d71ca245acad0ecd8495620098)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:14.849821 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:14.898744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0722d71ca245acad0ecd8495620098', 'request_id': 'req-f3c31690-5f16-45d5-a475-3387764610ad'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.900660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:14.904934 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0722d71ca245acad0ecd8495620098', 'request_id': 'req-f3c31690-5f16-45d5-a475-3387764610ad'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.912175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0722d71ca245acad0ecd8495620098', 'request_id': 'req-f3c31690-5f16-45d5-a475-3387764610ad'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.923319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] The token cache is being invalidate because project 6d0722d71ca245acad0ecd8495620098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:14.923607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.924275 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:14.925869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1339/2688] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:14 2022] DELETE /identity/v3/projects/6d0722d71ca245acad0ecd8495620098 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:14.929892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:14.939595 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165dd66-b73c-48cf-8e4d-2495a7ae0b04 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:14.947848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:14.999395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.000074 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.000360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.000640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] PATH_INFO: `/v3/users/8abef8d5bfd0465d9f610aba3db00da3` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.001770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abef8d5bfd0465d9f610aba3db00da3)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.004626 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.049901 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abef8d5bfd0465d9f610aba3db00da3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.050670 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abef8d5bfd0465d9f610aba3db00da3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.051280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abef8d5bfd0465d9f610aba3db00da3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.062969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abef8d5bfd0465d9f610aba3db00da3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.070972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-f1435544-d334-464a-a336-1a9d26a77fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abef8d5bfd0465d9f610aba3db00da3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.086063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1350/2689] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:14 2022] DELETE /identity/v3/users/8abef8d5bfd0465d9f610aba3db00da3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:15.366355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:15.367779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:15.383287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31690-5f16-45d5-a475-3387764610ad admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:15.439059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.440433 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.440858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.441138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] PATH_INFO: `/v3/projects/00034bdb5a494d789e02265bbb84f5da` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.442255 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00034bdb5a494d789e02265bbb84f5da)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.444248 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.490302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00034bdb5a494d789e02265bbb84f5da', 'request_id': 'req-74e21852-2769-4ad6-ba40-ecb95704bc59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.496243 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00034bdb5a494d789e02265bbb84f5da', 'request_id': 'req-74e21852-2769-4ad6-ba40-ecb95704bc59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.504074 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00034bdb5a494d789e02265bbb84f5da', 'request_id': 'req-74e21852-2769-4ad6-ba40-ecb95704bc59'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.515083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] The token cache is being invalidate because project 00034bdb5a494d789e02265bbb84f5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:15.515370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.516031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74e21852-2769-4ad6-ba40-ecb95704bc59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:15.517495 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1340/2690] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:15 2022] DELETE /identity/v3/projects/00034bdb5a494d789e02265bbb84f5da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:15.522476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abe4c-f49c-4a47-8c3a-bbfe8c8491c4 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.522961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abe4c-f49c-4a47-8c3a-bbfe8c8491c4 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.523069 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abe4c-f49c-4a47-8c3a-bbfe8c8491c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.542921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6f8abe4c-f49c-4a47-8c3a-bbfe8c8491c4 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:15.544166 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6f8abe4c-f49c-4a47-8c3a-bbfe8c8491c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:15.602796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1351/2691] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:15.610802 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f612c9-2af2-4382-8b67-57fc5080d4c2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.611088 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f612c9-2af2-4382-8b67-57fc5080d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.611364 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f612c9-2af2-4382-8b67-57fc5080d4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.632115 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-29f612c9-2af2-4382-8b67-57fc5080d4c2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:15.633311 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-29f612c9-2af2-4382-8b67-57fc5080d4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:15.641027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1341/2692] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:15.646872 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8abe4c-f49c-4a47-8c3a-bbfe8c8491c4 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:15.656573 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8abe4c-f49c-4a47-8c3a-bbfe8c8491c4 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:15.661665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.662259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.662537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.662812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.663478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:26:15.663778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.665398 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.677147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1352/2693] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:26:15.681319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f612c9-2af2-4382-8b67-57fc5080d4c2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:15.690596 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f612c9-2af2-4382-8b67-57fc5080d4c2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:15.695397 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.695971 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.696252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.696526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.697153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.699016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.725977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1342/2694] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:15 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:15.729987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:15.740624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72cced-a127-4560-8640-c42936b06984 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:15.752504 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:15.798523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.799147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.799458 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.799734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.801164 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.803324 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.827665 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1353/2695] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:15 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:15.829163 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:15.842145 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902a65a-ab89-4cf1-9715-a3ca33f02b6b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:15.847640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.848276 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.848556 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.848832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.849472 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.851057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.861444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1343/2696] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:15.865994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:15.875978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0f22-e6fe-4c5f-942b-fd10e119525f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:15.881139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eb769-f6cc-42fd-bb9d-cc662df6dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.881743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eb769-f6cc-42fd-bb9d-cc662df6dd64 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.882022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eb769-f6cc-42fd-bb9d-cc662df6dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.882294 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eb769-f6cc-42fd-bb9d-cc662df6dd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.882936 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eb769-f6cc-42fd-bb9d-cc662df6dd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.884912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eb769-f6cc-42fd-bb9d-cc662df6dd64 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.897780 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1354/2697] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:15.901827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:15.912701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d896a5e-17bc-4c48-9aa8-761712dc81f3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:15.917206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:15.917841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.918117 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.918386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] PATH_INFO: `/v3/projects/9648491e5074425680d0d19365ed3641/users/1be42c7996474ee78632e7a89ec5e291/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.934173 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9648491e5074425680d0d19365ed3641, user_id=1be42c7996474ee78632e7a89ec5e291, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:15.936837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:15.950026 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1344/2698] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:15 2022] PUT /identity/v3/projects/9648491e5074425680d0d19365ed3641/users/1be42c7996474ee78632e7a89ec5e291/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:15.960891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8fcf4-491e-4f35-b53c-d538b89ec177 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:15.961177 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8fcf4-491e-4f35-b53c-d538b89ec177 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:15.961478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8fcf4-491e-4f35-b53c-d538b89ec177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:15.989453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-baa8fcf4-491e-4f35-b53c-d538b89ec177 None None] MFA Rules not processed for user `1be42c7996474ee78632e7a89ec5e291`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:15.990661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-baa8fcf4-491e-4f35-b53c-d538b89ec177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:16.053427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1355/2699] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:16.057852 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:16.066557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:16.121281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5214637-1814-4072-9c39-9267cb622195 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:16.125859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:16.126454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.126730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.127001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.127625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:16.129634 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:16.157339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1345/2700] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:16 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:26:16.162617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8fcf4-491e-4f35-b53c-d538b89ec177 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:16.173336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8fcf4-491e-4f35-b53c-d538b89ec177 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:16.229689 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:16.230225 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.230510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.230789 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.231419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:16.233382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:16.254832 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1356/2701] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:16 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:16.258777 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:16.269962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81da720-299c-4f44-8e48-c565fca96523 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:16.274975 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:16.275562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.275861 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.276150 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.276773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:16.278349 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:16.289518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1346/2702] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:16.293629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:16.303744 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6baa14-d873-4180-8aa7-3d8e80fa4ca3 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:16.308389 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:16.309035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.309316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.309591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] PATH_INFO: `/v3/projects/dbae51487805494eb302aba21e93131e/users/9ba62c5c051d497197f6006eff196d05/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.322132 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:16.325624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbae51487805494eb302aba21e93131e, user_id=9ba62c5c051d497197f6006eff196d05, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:16.328926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:16.342754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1357/2703] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:16 2022] PUT /identity/v3/projects/dbae51487805494eb302aba21e93131e/users/9ba62c5c051d497197f6006eff196d05/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:16.346942 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:16.357046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c5c2b-d8ca-4c5e-b40a-088cbf33879d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:16.415172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364c4c0-2412-4a23-9f73-e9f2fcb7997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:16.415789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364c4c0-2412-4a23-9f73-e9f2fcb7997d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.416083 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364c4c0-2412-4a23-9f73-e9f2fcb7997d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.416409 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364c4c0-2412-4a23-9f73-e9f2fcb7997d admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.417055 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364c4c0-2412-4a23-9f73-e9f2fcb7997d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:16.418662 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364c4c0-2412-4a23-9f73-e9f2fcb7997d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:16.428467 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1347/2704] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:16.432592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:16.443515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da44d0-4593-4d18-bace-3e255b127e5d admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:16.448257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:16.448912 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.449199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.449480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] PATH_INFO: `/v3/projects/dbae51487805494eb302aba21e93131e/users/9ba62c5c051d497197f6006eff196d05/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.451409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbae51487805494eb302aba21e93131e, user_id=9ba62c5c051d497197f6006eff196d05, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:16.454117 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:16.464410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1358/2705] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:16 2022] PUT /identity/v3/projects/dbae51487805494eb302aba21e93131e/users/9ba62c5c051d497197f6006eff196d05/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:16.475362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929e38-0800-4c84-ad4c-40c0c3e8a87d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.475650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929e38-0800-4c84-ad4c-40c0c3e8a87d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.475962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00929e38-0800-4c84-ad4c-40c0c3e8a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.503926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-00929e38-0800-4c84-ad4c-40c0c3e8a87d None None] MFA Rules not processed for user `9ba62c5c051d497197f6006eff196d05`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:16.505085 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-00929e38-0800-4c84-ad4c-40c0c3e8a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:16.572093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1348/2706] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:16.582719 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:16.584581 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:16.641905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8392a-ed03-406d-a6a9-12f2ed02d710 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:16.646241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:16.646846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:16.647130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:16.647409 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:16.703434 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:16.704917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:16.714551 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1359/2707] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:20.935452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00929e38-0800-4c84-ad4c-40c0c3e8a87d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:20.940050 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:20.947451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00929e38-0800-4c84-ad4c-40c0c3e8a87d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:20.951383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:20.952010 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:20.952294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:20.952594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:20.962138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:20.963543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:20.973426 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1349/2708] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:23.834100 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:23.835991 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:23.932415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8935fa-6d9e-420d-875f-699ae63800d9 service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:23.938235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfdb95-53cb-4d37-98bf-7644bcff29d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:23.939059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfdb95-53cb-4d37-98bf-7644bcff29d5 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:23.939329 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfdb95-53cb-4d37-98bf-7644bcff29d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:23.939605 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfdb95-53cb-4d37-98bf-7644bcff29d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:23.941544 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2edfdb95-53cb-4d37-98bf-7644bcff29d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:23.960306 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfdb95-53cb-4d37-98bf-7644bcff29d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:23.962063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfdb95-53cb-4d37-98bf-7644bcff29d5 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:23.975482 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1360/2709] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:25.857528 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:25.928937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fe451-dd29-4a06-a870-46f10a36aaf5 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:25.933836 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:25.934926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:25.935279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:25.937660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] PATH_INFO: `/v3/users/1be42c7996474ee78632e7a89ec5e291` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:25.937660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be42c7996474ee78632e7a89ec5e291)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:25.939169 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:25.991921 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be42c7996474ee78632e7a89ec5e291'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:25.999599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be42c7996474ee78632e7a89ec5e291'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.000332 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be42c7996474ee78632e7a89ec5e291'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.016834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be42c7996474ee78632e7a89ec5e291'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.024722 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be42c7996474ee78632e7a89ec5e291'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.031058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1350/2710] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:25 2022] DELETE /identity/v3/users/1be42c7996474ee78632e7a89ec5e291 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:26.036538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:26.036999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:26.037264 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:26.060024 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:26.061442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:26.074137 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:26.126141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1361/2711] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:26.136165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:26.137576 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:26.202765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da495-6b12-4dfa-be16-85060b9f9b04 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:26.210920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:26.210920 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:26.211294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:26.211455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:26.221844 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:26.224161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:26.233831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1351/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:26:26.606056 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:26.607479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:26.619794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea5c27-97c4-48d6-9129-8bfe76eff74f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:26.625012 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:26.625794 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:26.626235 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:26.626653 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] PATH_INFO: `/v3/projects/9648491e5074425680d0d19365ed3641` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:26.627941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9648491e5074425680d0d19365ed3641)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:26.630226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:26.681375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9648491e5074425680d0d19365ed3641', 'request_id': 'req-7c44fe71-1f16-4f50-af39-f954dfe48abb'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.687272 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9648491e5074425680d0d19365ed3641', 'request_id': 'req-7c44fe71-1f16-4f50-af39-f954dfe48abb'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.695681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9648491e5074425680d0d19365ed3641', 'request_id': 'req-7c44fe71-1f16-4f50-af39-f954dfe48abb'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.709060 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] The token cache is being invalidate because project 9648491e5074425680d0d19365ed3641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:26.709284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.709923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.711401 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1362/2713] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:26 2022] DELETE /identity/v3/projects/9648491e5074425680d0d19365ed3641 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:26.715518 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:26.726670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935bbcb-3deb-459f-8858-8d1cf4e7a307 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:26.735087 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:26.787197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:26.787859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:26.788148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:26.788420 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] PATH_INFO: `/v3/users/9ba62c5c051d497197f6006eff196d05` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:26.789543 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba62c5c051d497197f6006eff196d05)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:26.791462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:26.848831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba62c5c051d497197f6006eff196d05'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.856605 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba62c5c051d497197f6006eff196d05'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.857304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba62c5c051d497197f6006eff196d05'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.869562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba62c5c051d497197f6006eff196d05'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.877253 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c23a6364-ce62-4059-a555-85fbc75ffc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba62c5c051d497197f6006eff196d05'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:26.884002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1352/2714] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:26 2022] DELETE /identity/v3/users/9ba62c5c051d497197f6006eff196d05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:27.170911 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.172485 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:27.193257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44fe71-1f16-4f50-af39-f954dfe48abb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:27.260119 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:27.260695 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.260978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.261256 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] PATH_INFO: `/v3/projects/dbae51487805494eb302aba21e93131e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.262530 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbae51487805494eb302aba21e93131e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:27.264650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:27.318486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:27.323903 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbae51487805494eb302aba21e93131e', 'request_id': 'req-98186162-82c2-4738-ab67-5a622bfd72b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:27.330837 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbae51487805494eb302aba21e93131e', 'request_id': 'req-98186162-82c2-4738-ab67-5a622bfd72b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:27.341509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbae51487805494eb302aba21e93131e', 'request_id': 'req-98186162-82c2-4738-ab67-5a622bfd72b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:27.355497 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] The token cache is being invalidate because project dbae51487805494eb302aba21e93131e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:27.355772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:27.356641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-98186162-82c2-4738-ab67-5a622bfd72b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:27.358586 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1363/2715] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:27 2022] DELETE /identity/v3/projects/dbae51487805494eb302aba21e93131e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:27.365582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e54a7-1a83-4f0b-a34e-b36504dfa546 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.365962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e54a7-1a83-4f0b-a34e-b36504dfa546 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.366134 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e54a7-1a83-4f0b-a34e-b36504dfa546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.389210 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-316e54a7-1a83-4f0b-a34e-b36504dfa546 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:27.390488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-316e54a7-1a83-4f0b-a34e-b36504dfa546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:27.454297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1353/2716] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:27.521049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e98e29-8ced-4b52-8564-06fe69bd3d85 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.521249 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e98e29-8ced-4b52-8564-06fe69bd3d85 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.521509 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e98e29-8ced-4b52-8564-06fe69bd3d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.541535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-57e98e29-8ced-4b52-8564-06fe69bd3d85 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:27.542778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-57e98e29-8ced-4b52-8564-06fe69bd3d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:27.550798 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1364/2717] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:27.555148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e54a7-1a83-4f0b-a34e-b36504dfa546 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.564627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e54a7-1a83-4f0b-a34e-b36504dfa546 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:27.569993 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:27.570599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.570880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.571153 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.571825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:26:27.572137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:27.573721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:27.586454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1354/2718] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:26:27.590871 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e98e29-8ced-4b52-8564-06fe69bd3d85 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.600818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e98e29-8ced-4b52-8564-06fe69bd3d85 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:27.605513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79494fb5-1401-40fd-a320-912c27859fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:27.606129 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494fb5-1401-40fd-a320-912c27859fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.606407 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494fb5-1401-40fd-a320-912c27859fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.606680 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79494fb5-1401-40fd-a320-912c27859fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.607319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79494fb5-1401-40fd-a320-912c27859fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:27.609288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79494fb5-1401-40fd-a320-912c27859fbd admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:27.639397 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1365/2719] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:27 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:27.643704 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.655307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3747-797b-4f2d-803d-eb7254cc2bd4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:27.668527 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:27.715466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8f04d-2356-4305-aff1-147849ead4f8 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.715757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8f04d-2356-4305-aff1-147849ead4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.716089 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8f04d-2356-4305-aff1-147849ead4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.721911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:27.722521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.723352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.723720 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.724663 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:27.726608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:27.735970 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-0bf8f04d-2356-4305-aff1-147849ead4f8 None None] MFA Rules not processed for user `efaa552d402646b28f2f52068558fce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:27.737189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-0bf8f04d-2356-4305-aff1-147849ead4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:27.751875 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1355/2720] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:27 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:27.753172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.763298 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77156459-8d58-4f5c-8454-bc3ad426325d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:27.767962 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:27.768552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.768827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.769098 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.769778 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:27.772039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:27.782395 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1356/2721] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:26:27.787008 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.794584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1366/2722] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:27.796622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059afc97-1cea-4d16-b978-dd63d54e81f6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:27.802363 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501be568-0822-4e4f-a5ca-ece2a5636a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:27.803172 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be568-0822-4e4f-a5ca-ece2a5636a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.803449 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be568-0822-4e4f-a5ca-ece2a5636a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.803717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be568-0822-4e4f-a5ca-ece2a5636a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.804387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501be568-0822-4e4f-a5ca-ece2a5636a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:27.806252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501be568-0822-4e4f-a5ca-ece2a5636a12 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:27.816054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1357/2723] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:26:27.820812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8f04d-2356-4305-aff1-147849ead4f8 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.832035 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8f04d-2356-4305-aff1-147849ead4f8 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:27.837427 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:27.838181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.838533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.838879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] PATH_INFO: `/v3/projects/a8c152aa2daf4ff4b909bc4973811cf0/users/6c254833ed6c4d63895c8e34583cc65d/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.855847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c152aa2daf4ff4b909bc4973811cf0, user_id=6c254833ed6c4d63895c8e34583cc65d, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:27.858493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:27.874723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1367/2724] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:27 2022] PUT /identity/v3/projects/a8c152aa2daf4ff4b909bc4973811cf0/users/6c254833ed6c4d63895c8e34583cc65d/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:27.886007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f554-c860-44b9-8c6a-44e791a2e342 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:27.886491 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f554-c860-44b9-8c6a-44e791a2e342 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:27.886621 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913f554-c860-44b9-8c6a-44e791a2e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:27.916783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0913f554-c860-44b9-8c6a-44e791a2e342 None None] MFA Rules not processed for user `6c254833ed6c4d63895c8e34583cc65d`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:27.918007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0913f554-c860-44b9-8c6a-44e791a2e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:27.983568 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1358/2725] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:27.997400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:27.999196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:28.058537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29061bfa-2c22-483f-9217-e0deab08b3c3 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:28.063475 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:28.064141 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.064424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.064701 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:28.074303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:28.075741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:28.085061 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1368/2726] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:26:28.105017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f554-c860-44b9-8c6a-44e791a2e342 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:28.115286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:28.116699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:28.149972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:28.170790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913f554-c860-44b9-8c6a-44e791a2e342 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:28.175377 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:28.176692 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.177121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.177407 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] PATH_INFO: `/v3/users/6c254833ed6c4d63895c8e34583cc65d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:28.177673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd97ad2-3c42-46ce-86c2-2f53f0d0f3fa service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:28.178558 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c254833ed6c4d63895c8e34583cc65d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:28.180504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:28.181357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482a925-9b99-4161-92a7-7bcaa4f41644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:28.181962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482a925-9b99-4161-92a7-7bcaa4f41644 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.182240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482a925-9b99-4161-92a7-7bcaa4f41644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.182510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482a925-9b99-4161-92a7-7bcaa4f41644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:28.184360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e482a925-9b99-4161-92a7-7bcaa4f41644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:28.194711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482a925-9b99-4161-92a7-7bcaa4f41644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:28.196173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482a925-9b99-4161-92a7-7bcaa4f41644 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:28.197614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:28.205065 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1369/2727] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:26:28.231923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c254833ed6c4d63895c8e34583cc65d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.240029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c254833ed6c4d63895c8e34583cc65d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.241034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c254833ed6c4d63895c8e34583cc65d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.253847 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c254833ed6c4d63895c8e34583cc65d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.262032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c254833ed6c4d63895c8e34583cc65d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.268474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1359/2728] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:28 2022] DELETE /identity/v3/users/6c254833ed6c4d63895c8e34583cc65d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:28.273266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.273555 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.273877 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:28.293356 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:28.294487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:28.357189 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1370/2729] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:28.369009 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:28.371028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:28.435018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f24a-8b01-43a4-a42e-06f165b4ae4e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:28.438807 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c68b2-c882-452b-9309-b711fd454c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:28.439421 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c68b2-c882-452b-9309-b711fd454c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.439701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c68b2-c882-452b-9309-b711fd454c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.440017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c68b2-c882-452b-9309-b711fd454c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:28.449246 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c68b2-c882-452b-9309-b711fd454c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:28.451021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c68b2-c882-452b-9309-b711fd454c1c service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:28.462500 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1360/2730] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:28.758257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:28.762922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:28.782118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b8def-a6b7-43e2-8671-89f6602562cc None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:28.788217 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:28.789062 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.789545 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.789862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] PATH_INFO: `/v3/projects/a8c152aa2daf4ff4b909bc4973811cf0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:28.791070 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c152aa2daf4ff4b909bc4973811cf0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:28.793059 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:28.846951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c152aa2daf4ff4b909bc4973811cf0', 'request_id': 'req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.853158 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c152aa2daf4ff4b909bc4973811cf0', 'request_id': 'req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.860722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c152aa2daf4ff4b909bc4973811cf0', 'request_id': 'req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.872321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] The token cache is being invalidate because project a8c152aa2daf4ff4b909bc4973811cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:28.872533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.873190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-2b9b7a2d-c3e0-447e-9fb2-c342d8b7a059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:28.874691 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1371/2731] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:28 2022] DELETE /identity/v3/projects/a8c152aa2daf4ff4b909bc4973811cf0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:28.880352 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404e26-db19-4114-aa9d-7546dd030053 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.880627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404e26-db19-4114-aa9d-7546dd030053 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.880904 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404e26-db19-4114-aa9d-7546dd030053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:28.901384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-21404e26-db19-4114-aa9d-7546dd030053 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:28.902928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-21404e26-db19-4114-aa9d-7546dd030053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:28.965428 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1361/2732] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:28.974396 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebea745-fc6e-4579-97f1-64bf7abd0189 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:28.974770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebea745-fc6e-4579-97f1-64bf7abd0189 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:28.975045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebea745-fc6e-4579-97f1-64bf7abd0189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.000252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-6ebea745-fc6e-4579-97f1-64bf7abd0189 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:29.001476 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6ebea745-fc6e-4579-97f1-64bf7abd0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:29.011245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1372/2733] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:26:29.015738 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21404e26-db19-4114-aa9d-7546dd030053 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:29.027080 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21404e26-db19-4114-aa9d-7546dd030053 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:29.032357 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:29.032989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.033274 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.033544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.034227 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:26:29.034535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:29.036200 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:29.048424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1362/2734] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:26:29.053346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebea745-fc6e-4579-97f1-64bf7abd0189 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:29.063037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebea745-fc6e-4579-97f1-64bf7abd0189 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:29.068622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:29.069222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.069500 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.069767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.070384 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:29.072613 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:29.100512 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1373/2735] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:29 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:29.104632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:29.115144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31d90c-dbf4-4f45-886e-29ddd1f6423d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:29.138234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:29.178468 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:29.179299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.179583 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.179940 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.180793 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:29.182701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:29.208254 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1363/2736] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:29 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:29.212533 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:29.223753 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e22676-c69f-48db-b3b7-18c600c7ec40 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:29.228741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:29.229474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.229754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.230026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.230683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:29.232478 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:29.366357 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1374/2737] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:29.370647 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:29.381541 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d70ebb-6784-45fd-b5de-70bc3900262b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:29.386135 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e8520-f0fe-429a-b585-862f479d8127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:29.386726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8520-f0fe-429a-b585-862f479d8127 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.387001 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8520-f0fe-429a-b585-862f479d8127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.387267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e8520-f0fe-429a-b585-862f479d8127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.387931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e8520-f0fe-429a-b585-862f479d8127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:29.389497 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e8520-f0fe-429a-b585-862f479d8127 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:29.400024 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1364/2738] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:29.403890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:29.413865 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392576c4-168e-42c5-b633-f6a1b3a9b6f9 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:29.418448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:29.419091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.419367 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.419642 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] PATH_INFO: `/v3/projects/40dae7a29f98434186418a4c9509101e/users/e48328fb833d450484485ca5d890363d/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.430974 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:29.435505 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40dae7a29f98434186418a4c9509101e, user_id=e48328fb833d450484485ca5d890363d, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:29.438366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:29.451883 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1375/2739] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:29 2022] PUT /identity/v3/projects/40dae7a29f98434186418a4c9509101e/users/e48328fb833d450484485ca5d890363d/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:29.463183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587588d-ff5e-4036-be0d-dc9bd84357ce None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.463470 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587588d-ff5e-4036-be0d-dc9bd84357ce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.463746 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587588d-ff5e-4036-be0d-dc9bd84357ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.491601 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d587588d-ff5e-4036-be0d-dc9bd84357ce None None] MFA Rules not processed for user `e48328fb833d450484485ca5d890363d`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:29.492841 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d587588d-ff5e-4036-be0d-dc9bd84357ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:29.557388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1365/2740] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:29.569625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:29.571415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:29.653333 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b972da-9cbd-44cb-b2e7-9e91c47ce7f4 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:29.658081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68627df-f61b-4665-9b8d-63b8c269e4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:29.658772 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68627df-f61b-4665-9b8d-63b8c269e4aa service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:29.659058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68627df-f61b-4665-9b8d-63b8c269e4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:29.659382 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68627df-f61b-4665-9b8d-63b8c269e4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:29.681048 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68627df-f61b-4665-9b8d-63b8c269e4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:29.690439 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68627df-f61b-4665-9b8d-63b8c269e4aa service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:29.705118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1376/2741] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:39.554664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=55,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:39.699731 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:49.324076 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587588d-ff5e-4036-be0d-dc9bd84357ce None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:49.385565 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587588d-ff5e-4036-be0d-dc9bd84357ce None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:49.389990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:49.390612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:49.390887 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:49.391158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] PATH_INFO: `/v3/users/e48328fb833d450484485ca5d890363d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:49.392287 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48328fb833d450484485ca5d890363d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:49.394176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:49.438438 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48328fb833d450484485ca5d890363d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:49.446065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48328fb833d450484485ca5d890363d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:49.446742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48328fb833d450484485ca5d890363d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:49.459234 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48328fb833d450484485ca5d890363d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:49.466661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48328fb833d450484485ca5d890363d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:49.472882 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1366/2742] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:26:49 2022] DELETE /identity/v3/users/e48328fb833d450484485ca5d890363d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:49.477334 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:49.477928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:49.477928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:49.498411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:49.499619 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:49.557710 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1377/2743] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:49.567864 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:49.569241 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:49.627486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303893-cfec-42a9-b02b-e0c7f62814ca admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:49.631863 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62833871-66a2-4c49-bc10-6d2b2bc94597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:49.632464 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833871-66a2-4c49-bc10-6d2b2bc94597 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:49.632740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833871-66a2-4c49-bc10-6d2b2bc94597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:49.633032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833871-66a2-4c49-bc10-6d2b2bc94597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:49.641696 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62833871-66a2-4c49-bc10-6d2b2bc94597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:49.643103 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62833871-66a2-4c49-bc10-6d2b2bc94597 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:49.653061 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1367/2744] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:49.917661 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:49.919113 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:49.935046 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a3d68-781d-4c44-964d-2d298c6fbe60 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:49.940463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:49.941257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:49.941989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:49.942318 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] PATH_INFO: `/v3/projects/40dae7a29f98434186418a4c9509101e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:49.943419 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40dae7a29f98434186418a4c9509101e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:49.945395 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:49.993201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40dae7a29f98434186418a4c9509101e', 'request_id': 'req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:49.998614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40dae7a29f98434186418a4c9509101e', 'request_id': 'req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:50.005790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40dae7a29f98434186418a4c9509101e', 'request_id': 'req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:50.016734 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] The token cache is being invalidate because project 40dae7a29f98434186418a4c9509101e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:26:50.017022 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:50.017630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-21bc6ae7-4858-4b62-b978-0f0ab2e7c1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:26:50.019114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1378/2745] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:26:49 2022] DELETE /identity/v3/projects/40dae7a29f98434186418a4c9509101e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:50.024501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e395-d82a-427f-a271-65e8c4765be6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.024892 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e395-d82a-427f-a271-65e8c4765be6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.025202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e395-d82a-427f-a271-65e8c4765be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.045259 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8725e395-d82a-427f-a271-65e8c4765be6 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:50.046457 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8725e395-d82a-427f-a271-65e8c4765be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:50.063912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:50.108509 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1368/2746] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:50.118412 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd367-da84-4c80-847f-f7dea84c06de None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.118703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd367-da84-4c80-847f-f7dea84c06de None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.119171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd367-da84-4c80-847f-f7dea84c06de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.139007 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2fdbd367-da84-4c80-847f-f7dea84c06de None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:50.140265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2fdbd367-da84-4c80-847f-f7dea84c06de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:50.148413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1379/2747] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:50.152677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725e395-d82a-427f-a271-65e8c4765be6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:50.162721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725e395-d82a-427f-a271-65e8c4765be6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:50.167206 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:50.167788 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.168093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.168361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.168996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:26:50.169294 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:50.170855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:50.182728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1369/2748] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:26:50.186786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbd367-da84-4c80-847f-f7dea84c06de None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:50.196252 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbd367-da84-4c80-847f-f7dea84c06de None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:50.200965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:50.201557 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.201839 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.202115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.202767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:50.204699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:50.231886 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1380/2749] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:50 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:50.236003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:50.246728 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff0ea0-21bf-4656-8b1c-c7457d0768b3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:50.302612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:50.303209 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.303490 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.303765 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.304422 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:50.306320 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:50.326775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1370/2750] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:50 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:26:50.330919 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:50.341167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235853af-7e21-49f6-831e-2afd96647fd0 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:50.346003 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:50.346599 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.346878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.347150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.348541 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:50.350118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:50.359878 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1381/2751] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:50.364562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:50.374342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb244b4-7e12-43ad-a2bd-30845fbed224 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:50.378911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146e989-14fb-446b-b02d-35da581df6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:50.379693 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e989-14fb-446b-b02d-35da581df6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.380002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e989-14fb-446b-b02d-35da581df6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.380292 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146e989-14fb-446b-b02d-35da581df6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.380907 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146e989-14fb-446b-b02d-35da581df6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:50.382487 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146e989-14fb-446b-b02d-35da581df6f9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:50.392771 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1371/2752] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:50.397438 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:50.407140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512b15b-e9cd-4364-85f4-def9fde5e134 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:50.412321 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:50.412975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.413250 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.413523 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] PATH_INFO: `/v3/projects/035e36bbf4bc4c6384765fde5bde5b26/users/a4405fb9580444eda2c63017ebc41d78/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.427767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035e36bbf4bc4c6384765fde5bde5b26, user_id=a4405fb9580444eda2c63017ebc41d78, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:50.430961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:50.443870 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1382/2753] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:50 2022] PUT /identity/v3/projects/035e36bbf4bc4c6384765fde5bde5b26/users/a4405fb9580444eda2c63017ebc41d78/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:50.448766 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd33ef-45ef-4019-8632-ecd863145d2c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.449053 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd33ef-45ef-4019-8632-ecd863145d2c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.449355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd33ef-45ef-4019-8632-ecd863145d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.468355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a3fd33ef-45ef-4019-8632-ecd863145d2c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:50.469813 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a3fd33ef-45ef-4019-8632-ecd863145d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:50.529965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1372/2754] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:50.540490 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:50.542243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:50.563714 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:50.601279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eb25c-e31d-4928-ae1d-5a6ba2ff28b0 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:50.605026 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:50.605627 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:50.605907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:50.606179 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:50.615635 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:50.617066 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:50.626667 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1383/2755] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:26:54.278548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29902-482c-4f12-8815-f17ec03f16b7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:54.279113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29902-482c-4f12-8815-f17ec03f16b7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:54.279113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29902-482c-4f12-8815-f17ec03f16b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:54.318033 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6ee29902-482c-4f12-8815-f17ec03f16b7 None None] MFA Rules not processed for user `a4405fb9580444eda2c63017ebc41d78`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:54.319316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6ee29902-482c-4f12-8815-f17ec03f16b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:54.338099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:54.393239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1373/2756] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:54.397559 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:54.407381 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d0df3-e5a0-495d-8cba-2b722094a35d service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:54.411980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:54.412585 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:54.412867 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:54.413143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:54.413811 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:54.415729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:54.447847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1384/2757] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:26:54 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:54.452027 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee29902-482c-4f12-8815-f17ec03f16b7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:54.464474 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee29902-482c-4f12-8815-f17ec03f16b7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:54.575486 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:54.576297 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:54.576673 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:54.577044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:54.578207 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:54.579779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:54.609192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1374/2758] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:26:54 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:26:54.613894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:54.624952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e52cf2-3ce9-47d5-853a-6f97c96b23cb admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:54.629866 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:54.630814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:54.630814 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:54.631053 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:54.631654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:54.633304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:54.645760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1385/2759] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:54.650232 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:54.662129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153ff87-1d32-4676-a64c-9a92f78d0ecb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:54.666832 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:54.667508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:54.667792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:54.668109 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] PATH_INFO: `/v3/projects/471361a1cbe64f62afa1da6cd064dc65/users/a338590a3c5b435fadb1d9af83419294/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:54.684086 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471361a1cbe64f62afa1da6cd064dc65, user_id=a338590a3c5b435fadb1d9af83419294, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:54.686871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:54.701641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1375/2760] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:54 2022] PUT /identity/v3/projects/471361a1cbe64f62afa1da6cd064dc65/users/a338590a3c5b435fadb1d9af83419294/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:54.705592 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:54.716747 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76253b16-7edd-4ce1-9f63-65a1c052cf63 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:54.778017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80fb94-07a6-463e-99d5-34738f505a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:54.778539 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80fb94-07a6-463e-99d5-34738f505a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:54.778827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80fb94-07a6-463e-99d5-34738f505a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:54.779106 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80fb94-07a6-463e-99d5-34738f505a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:54.779762 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80fb94-07a6-463e-99d5-34738f505a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:54.781576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80fb94-07a6-463e-99d5-34738f505a54 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:54.793083 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1386/2761] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:26:54.796872 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:54.808031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7bc5-c72f-4c6b-8b9c-d57cbad713e6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:54.812787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:54.813454 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:54.813736 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:54.814016 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] PATH_INFO: `/v3/projects/471361a1cbe64f62afa1da6cd064dc65/users/a338590a3c5b435fadb1d9af83419294/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:54.815995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471361a1cbe64f62afa1da6cd064dc65, user_id=a338590a3c5b435fadb1d9af83419294, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:54.819215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:54.830930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1376/2762] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:26:54 2022] PUT /identity/v3/projects/471361a1cbe64f62afa1da6cd064dc65/users/a338590a3c5b435fadb1d9af83419294/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:26:59.236952 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0311e3d-ee9c-4476-8c4e-5a7e8ea53952 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:59.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0311e3d-ee9c-4476-8c4e-5a7e8ea53952 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:59.237493 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0311e3d-ee9c-4476-8c4e-5a7e8ea53952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:59.272706 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c0311e3d-ee9c-4476-8c4e-5a7e8ea53952 None None] MFA Rules not processed for user `a338590a3c5b435fadb1d9af83419294`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:26:59.274057 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c0311e3d-ee9c-4476-8c4e-5a7e8ea53952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:59.361415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1387/2763] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:26:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:26:59.378902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:26:59.385567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:26:59.477941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc53933-5ed2-477d-89be-d593c923e590 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:26:59.484022 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:26:59.484652 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:26:59.484931 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:26:59.485204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:26:59.491344 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:26:59.547731 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:26:59.548998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:26:59.558924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1377/2764] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:00.557941 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ba1b4-604b-407e-b82c-cbfb6d42ffca None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:00.558474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ba1b4-604b-407e-b82c-cbfb6d42ffca None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:00.558474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ba1b4-604b-407e-b82c-cbfb6d42ffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:00.579093 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-d34ba1b4-604b-407e-b82c-cbfb6d42ffca None None] MFA Rules not processed for user `a4405fb9580444eda2c63017ebc41d78`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:00.580348 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d34ba1b4-604b-407e-b82c-cbfb6d42ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:00.588666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1388/2765] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:09.554598 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=24 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:10.572891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:17.606188 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:17.607646 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:17.679764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebb1d-29e0-4c9a-8c21-4919acc5db0d service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:17.685136 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:17.685742 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:17.686017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:17.686289 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:17.688030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:17.700039 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:17.701594 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:17.711230 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1378/2766] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:27.707144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=32 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:31.236319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ba1b4-604b-407e-b82c-cbfb6d42ffca None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:31.250349 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ba1b4-604b-407e-b82c-cbfb6d42ffca None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:31.255961 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:31.256624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:31.256900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:31.257167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:31.258922 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:31.271300 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:31.272906 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:31.284238 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1389/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:34.331272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:34.386730 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a168e-73bf-4339-8e4a-ffe2d458796d service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:34.390381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:34.390986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:34.391267 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:34.391539 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:34.400964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:34.402383 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:34.412032 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1379/2768] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:41.280899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=6 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:44.407561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=26 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:48.719366 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:48.721213 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:48.787890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c2b6-e98e-4fc8-91c1-2953e9627b2f service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:48.792750 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:48.793447 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:48.793727 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:48.794023 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] PATH_INFO: `/v3/users/efaa552d402646b28f2f52068558fce0` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:48.795147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] RBAC: Authorizing `identity:delete_user(user_id=efaa552d402646b28f2f52068558fce0)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:48.797095 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:48.850432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efaa552d402646b28f2f52068558fce0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.851044 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efaa552d402646b28f2f52068558fce0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.851648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efaa552d402646b28f2f52068558fce0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.864040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efaa552d402646b28f2f52068558fce0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.871432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-ad901599-4217-4818-8be6-2008d7a5269a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efaa552d402646b28f2f52068558fce0'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:48.884722 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1390/2769] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:27:48 2022] DELETE /identity/v3/users/efaa552d402646b28f2f52068558fce0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:49.059548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.071116 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769868c2-0b6c-4bd0-a34d-9936f4f04fbb service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.136670 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.137300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.137612 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.137885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] PATH_INFO: `/v3/projects/c0011ec6367f43859c048642b2c324a1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.139007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0011ec6367f43859c048642b2c324a1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.140992 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.186755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0011ec6367f43859c048642b2c324a1', 'request_id': 'req-f2aa2f0c-f1ec-4680-be48-f705c708029d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.192233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0011ec6367f43859c048642b2c324a1', 'request_id': 'req-f2aa2f0c-f1ec-4680-be48-f705c708029d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.199326 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0011ec6367f43859c048642b2c324a1', 'request_id': 'req-f2aa2f0c-f1ec-4680-be48-f705c708029d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.210271 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] The token cache is being invalidate because project c0011ec6367f43859c048642b2c324a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:27:49.210537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.211159 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2aa2f0c-f1ec-4680-be48-f705c708029d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:49.213379 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1380/2770] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:27:49 2022] DELETE /identity/v3/projects/c0011ec6367f43859c048642b2c324a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:27:49.218273 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba850f-e41d-4c46-bfeb-64b4f574d894 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.218563 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba850f-e41d-4c46-bfeb-64b4f574d894 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.218840 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba850f-e41d-4c46-bfeb-64b4f574d894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.238937 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e7ba850f-e41d-4c46-bfeb-64b4f574d894 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:49.240173 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e7ba850f-e41d-4c46-bfeb-64b4f574d894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:49.297786 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1391/2771] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:49.305261 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375119-0358-47b3-a19e-74c17b996e6c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.305544 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375119-0358-47b3-a19e-74c17b996e6c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.305818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375119-0358-47b3-a19e-74c17b996e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.326157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2c375119-0358-47b3-a19e-74c17b996e6c None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:49.327338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2c375119-0358-47b3-a19e-74c17b996e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:49.335040 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1381/2772] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:49.340091 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba850f-e41d-4c46-bfeb-64b4f574d894 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.349969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba850f-e41d-4c46-bfeb-64b4f574d894 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.355153 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.355770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.356077 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.356351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.356989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:27:49.357317 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.358909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.370191 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1392/2773] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:27:49.374323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375119-0358-47b3-a19e-74c17b996e6c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.383373 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375119-0358-47b3-a19e-74c17b996e6c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.388313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.388839 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.389111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.389376 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.389995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.391885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.419370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1382/2774] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:27:49.423437 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.433754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fc9fd-9ca1-469f-b9ad-9269bb1896a7 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.437358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:49.491514 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.492136 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.492415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.492687 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.493304 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.495410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.515510 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1393/2775] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:49.519578 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.530462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbcbbf-f321-479f-aeae-8de7c381722e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.535144 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.535744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.536065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.536381 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.536965 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.538542 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.549552 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1383/2776] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:49.553553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.563571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabad620-0501-49fb-9f53-f820f7e6397d admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.568068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6a7e-3e35-4eb7-9127-658b7c81eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.568657 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6a7e-3e35-4eb7-9127-658b7c81eb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.568933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6a7e-3e35-4eb7-9127-658b7c81eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.569204 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6a7e-3e35-4eb7-9127-658b7c81eb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.569841 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6a7e-3e35-4eb7-9127-658b7c81eb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.571415 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6a7e-3e35-4eb7-9127-658b7c81eb99 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.582222 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1394/2777] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:49.586158 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.597883 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3f6d-06a0-4586-a4bf-c4353ab181e0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.602668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.603873 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.604161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.604429 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] PATH_INFO: `/v3/projects/9464184bc45e4c48891f1e02bf7a3686/users/56bed200030542359dd0bcad9695d3b8/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.619331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9464184bc45e4c48891f1e02bf7a3686, user_id=56bed200030542359dd0bcad9695d3b8, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.622025 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.634100 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1384/2778] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:27:49 2022] PUT /identity/v3/projects/9464184bc45e4c48891f1e02bf7a3686/users/56bed200030542359dd0bcad9695d3b8/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:49.644206 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a867-3eb8-42cd-b77b-eb452a75dc8e None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.644433 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a867-3eb8-42cd-b77b-eb452a75dc8e None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.644725 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5a867-3eb8-42cd-b77b-eb452a75dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.672316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-b0a5a867-3eb8-42cd-b77b-eb452a75dc8e None None] MFA Rules not processed for user `56bed200030542359dd0bcad9695d3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:49.673550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b0a5a867-3eb8-42cd-b77b-eb452a75dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:49.741114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1395/2779] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:49.753329 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:49.755011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:49.789808 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:49.835324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ce0a0-67cb-41a7-a945-7cc12810541e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:49.841174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f3ce1-0e33-45c3-9291-b51748c7474a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:49.841795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3ce1-0e33-45c3-9291-b51748c7474a service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:49.842078 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3ce1-0e33-45c3-9291-b51748c7474a service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:49.842355 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3ce1-0e33-45c3-9291-b51748c7474a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:49.850650 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f3ce1-0e33-45c3-9291-b51748c7474a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:49.852262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f3ce1-0e33-45c3-9291-b51748c7474a service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:49.862477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1385/2780] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:27:57.141740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a867-3eb8-42cd-b77b-eb452a75dc8e None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:57.202534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5a867-3eb8-42cd-b77b-eb452a75dc8e None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:57.207013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:57.207636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:57.207942 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:57.208244 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] PATH_INFO: `/v3/users/56bed200030542359dd0bcad9695d3b8` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:57.209452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bed200030542359dd0bcad9695d3b8)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:57.211404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:57.227732 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:57.259640 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bed200030542359dd0bcad9695d3b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.260572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bed200030542359dd0bcad9695d3b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.261181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bed200030542359dd0bcad9695d3b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.272798 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bed200030542359dd0bcad9695d3b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.279451 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bed200030542359dd0bcad9695d3b8'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.292821 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1396/2781] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:27:57 2022] DELETE /identity/v3/users/56bed200030542359dd0bcad9695d3b8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:57.297218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:57.297726 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:57.297826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:57.317175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:57.318370 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:57.377182 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1386/2782] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:57.386885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:57.388343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:57.445216 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81ab51-d6cf-4e78-9e07-1260805e8834 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:57.449232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838eb8-6598-45ca-9ab0-b7a26ecd2da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:57.449843 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838eb8-6598-45ca-9ab0-b7a26ecd2da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:57.450118 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838eb8-6598-45ca-9ab0-b7a26ecd2da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:57.450387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838eb8-6598-45ca-9ab0-b7a26ecd2da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:57.459448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e838eb8-6598-45ca-9ab0-b7a26ecd2da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:57.460916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e838eb8-6598-45ca-9ab0-b7a26ecd2da9 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:57.471134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1397/2783] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:27:57.737585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:57.739081 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:57.751911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c495-a138-493e-b5c7-2a46a9f3c981 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:57.756694 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:57.757331 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:57.758048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:57.758048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] PATH_INFO: `/v3/projects/9464184bc45e4c48891f1e02bf7a3686` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:57.758994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9464184bc45e4c48891f1e02bf7a3686)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:57.761676 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:57.808752 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9464184bc45e4c48891f1e02bf7a3686', 'request_id': 'req-c7614265-0c86-4dda-a9af-3853c4676f68'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.814174 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9464184bc45e4c48891f1e02bf7a3686', 'request_id': 'req-c7614265-0c86-4dda-a9af-3853c4676f68'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.821386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9464184bc45e4c48891f1e02bf7a3686', 'request_id': 'req-c7614265-0c86-4dda-a9af-3853c4676f68'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.833674 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] The token cache is being invalidate because project 9464184bc45e4c48891f1e02bf7a3686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:27:57.833970 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.834643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7614265-0c86-4dda-a9af-3853c4676f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:27:57.836245 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1387/2784] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:27:57 2022] DELETE /identity/v3/projects/9464184bc45e4c48891f1e02bf7a3686 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:57.842139 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d1761-b5ca-43ae-9b48-e1b644c4e996 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:57.842432 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d1761-b5ca-43ae-9b48-e1b644c4e996 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:57.842721 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d1761-b5ca-43ae-9b48-e1b644c4e996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:57.864314 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-510d1761-b5ca-43ae-9b48-e1b644c4e996 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:57.865535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-510d1761-b5ca-43ae-9b48-e1b644c4e996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:57.923962 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1398/2785] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:57.933003 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a5d7-4809-4ee6-a05e-bc91539b7863 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:57.933305 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a5d7-4809-4ee6-a05e-bc91539b7863 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:57.933608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a5d7-4809-4ee6-a05e-bc91539b7863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:57.953393 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-62e1a5d7-4809-4ee6-a05e-bc91539b7863 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:57.954599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-62e1a5d7-4809-4ee6-a05e-bc91539b7863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:57.962341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1388/2786] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:57.967338 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d1761-b5ca-43ae-9b48-e1b644c4e996 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:57.977151 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d1761-b5ca-43ae-9b48-e1b644c4e996 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:57.982030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:57.982629 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:57.982909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:57.983183 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:57.983858 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:27:57.984165 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:57.985757 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:57.997148 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1399/2787] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:27:58.001380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a5d7-4809-4ee6-a05e-bc91539b7863 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.010979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a5d7-4809-4ee6-a05e-bc91539b7863 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.015622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.016240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.016522 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.016796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.017424 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.019302 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.046996 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1389/2788] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:27:58 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:58.051110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.061345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c23e3-59d6-48a8-bef9-70c8365b9600 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.081764 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:58.120776 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.121413 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.121696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.121973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.122622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.124614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.145890 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1400/2789] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:27:58 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:58.151252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.164046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2517-9650-43dd-9331-163d7be450a0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.168961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.169567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.169848 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.170121 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.170792 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.172412 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.173755 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:58.185795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1390/2790] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:58.189584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.204224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae6785-94d7-476f-a70f-aac849694bd2 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.208940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a227da-2790-40d8-9dbf-1ad2aed933af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.209558 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a227da-2790-40d8-9dbf-1ad2aed933af admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.209835 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a227da-2790-40d8-9dbf-1ad2aed933af admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.210109 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a227da-2790-40d8-9dbf-1ad2aed933af admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.210745 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a227da-2790-40d8-9dbf-1ad2aed933af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.212400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a227da-2790-40d8-9dbf-1ad2aed933af admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.223442 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1401/2791] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:58.227639 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.237830 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b788b6-c576-4942-a757-520c9d9bdf95 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.242360 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.243000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.243280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.243551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] PATH_INFO: `/v3/projects/63df4f054dd4487c8af8adb6bfe3581a/users/19cc9a4d17824d5badbc719512e715ba/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.258336 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63df4f054dd4487c8af8adb6bfe3581a, user_id=19cc9a4d17824d5badbc719512e715ba, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.261928 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.274661 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1391/2792] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:27:58 2022] PUT /identity/v3/projects/63df4f054dd4487c8af8adb6bfe3581a/users/19cc9a4d17824d5badbc719512e715ba/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:58.284986 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258c135-a3bd-4e1c-9cf8-1d8aa4c07eae None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.285274 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258c135-a3bd-4e1c-9cf8-1d8aa4c07eae None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.285554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258c135-a3bd-4e1c-9cf8-1d8aa4c07eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.314047 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-e258c135-a3bd-4e1c-9cf8-1d8aa4c07eae None None] MFA Rules not processed for user `19cc9a4d17824d5badbc719512e715ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:58.315319 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-e258c135-a3bd-4e1c-9cf8-1d8aa4c07eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:58.378265 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1402/2793] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:58.382748 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.448341 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd66e0-a4bd-4b42-a94a-66038c0af050 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.453165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.453776 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.454056 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.454328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.454963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.456891 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.485054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1392/2794] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:27:58 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:58.489101 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258c135-a3bd-4e1c-9cf8-1d8aa4c07eae None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.500547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258c135-a3bd-4e1c-9cf8-1d8aa4c07eae None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.555880 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.557171 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.557494 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.557770 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.558377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.560328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.580598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1403/2795] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:27:58 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:27:58.584794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.595570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517448eb-2694-4847-9535-ac40450ecd9b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.600141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.600740 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.601020 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.601293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.601933 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.604189 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.614725 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1393/2796] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:58.618703 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.629502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d75f-e741-4437-be22-dcb527ad577a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.634182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.634834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.635115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.635394 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] PATH_INFO: `/v3/projects/f1a2d8430e8648eead39040891ce37d9/users/677a19ad11304611a8d81eb92526e4d6/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.650712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a2d8430e8648eead39040891ce37d9, user_id=677a19ad11304611a8d81eb92526e4d6, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.653383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.660914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:58.667686 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1404/2797] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:27:58 2022] PUT /identity/v3/projects/f1a2d8430e8648eead39040891ce37d9/users/677a19ad11304611a8d81eb92526e4d6/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:58.671637 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.682178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9768bfe-03b2-4669-ac50-2a8b3ce968fb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.739029 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f93ee-8add-4195-9f11-c360f18ee55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.739557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f93ee-8add-4195-9f11-c360f18ee55d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.739865 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f93ee-8add-4195-9f11-c360f18ee55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.740141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f93ee-8add-4195-9f11-c360f18ee55d admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.740780 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f93ee-8add-4195-9f11-c360f18ee55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.742392 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f93ee-8add-4195-9f11-c360f18ee55d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.752455 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1394/2798] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:27:58.756708 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.767232 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575e92-3534-403f-8c0f-ab31b25b4c94 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.771989 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.772673 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.772959 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.773239 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] PATH_INFO: `/v3/projects/f1a2d8430e8648eead39040891ce37d9/users/677a19ad11304611a8d81eb92526e4d6/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.775336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a2d8430e8648eead39040891ce37d9, user_id=677a19ad11304611a8d81eb92526e4d6, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.778038 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.788534 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1405/2799] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:27:58 2022] PUT /identity/v3/projects/f1a2d8430e8648eead39040891ce37d9/users/677a19ad11304611a8d81eb92526e4d6/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:27:58.799058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221de2-479c-4d7b-957c-996e7ccaa3d1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.799343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221de2-479c-4d7b-957c-996e7ccaa3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.799616 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221de2-479c-4d7b-957c-996e7ccaa3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.827511 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e4221de2-479c-4d7b-957c-996e7ccaa3d1 None None] MFA Rules not processed for user `677a19ad11304611a8d81eb92526e4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:27:58.828759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e4221de2-479c-4d7b-957c-996e7ccaa3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:58.860446 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:27:58.898977 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1395/2800] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:27:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:27:58.911836 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:27:58.913621 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:27:58.971020 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7953a-e2a0-44d9-ba87-7e66b713d468 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:27:58.974672 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9d63-7f0f-49d6-9470-1bfe030459b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:27:58.975276 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9d63-7f0f-49d6-9470-1bfe030459b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:27:58.975560 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9d63-7f0f-49d6-9470-1bfe030459b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:27:58.975862 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9d63-7f0f-49d6-9470-1bfe030459b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:27:58.985604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9d63-7f0f-49d6-9470-1bfe030459b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:27:58.987031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9d63-7f0f-49d6-9470-1bfe030459b4 service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:27:58.996664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1406/2801] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:27:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:00.320979 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221de2-479c-4d7b-957c-996e7ccaa3d1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:00.382313 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221de2-479c-4d7b-957c-996e7ccaa3d1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:00.387215 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:00.387862 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:00.388141 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:00.388410 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] PATH_INFO: `/v3/users/19cc9a4d17824d5badbc719512e715ba` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:00.389508 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19cc9a4d17824d5badbc719512e715ba)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:00.391387 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:00.436990 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19cc9a4d17824d5badbc719512e715ba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:00.443908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19cc9a4d17824d5badbc719512e715ba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:00.444574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19cc9a4d17824d5badbc719512e715ba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:00.457338 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19cc9a4d17824d5badbc719512e715ba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:00.465733 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19cc9a4d17824d5badbc719512e715ba'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:00.472280 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1396/2802] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:00 2022] DELETE /identity/v3/users/19cc9a4d17824d5badbc719512e715ba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:00.476854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:00.477335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:00.477448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:00.497368 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:00.498577 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:00.556199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1407/2803] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:00.565620 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:00.567030 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:00.619561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:00.626148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcc411-671a-465e-ae6f-0a0a1966249b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:00.630599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:00.631202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:00.631481 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:00.631753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:00.640773 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:00.642184 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:00.652031 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1397/2804] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:00.917175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:00.918634 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:00.931080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6127a4-f8d8-4b23-9384-89076b4bac75 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:00.936292 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:00.936940 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:00.937219 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:00.937681 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] PATH_INFO: `/v3/projects/63df4f054dd4487c8af8adb6bfe3581a` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:00.938820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63df4f054dd4487c8af8adb6bfe3581a)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:00.941328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:00.987740 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63df4f054dd4487c8af8adb6bfe3581a', 'request_id': 'req-9c18d60c-88d6-4f1c-9f08-839766738861'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:00.993175 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63df4f054dd4487c8af8adb6bfe3581a', 'request_id': 'req-9c18d60c-88d6-4f1c-9f08-839766738861'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.001343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63df4f054dd4487c8af8adb6bfe3581a', 'request_id': 'req-9c18d60c-88d6-4f1c-9f08-839766738861'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.013373 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] The token cache is being invalidate because project 63df4f054dd4487c8af8adb6bfe3581a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:01.013696 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.014339 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.015818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1408/2805] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:00 2022] DELETE /identity/v3/projects/63df4f054dd4487c8af8adb6bfe3581a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:28:01.019775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:01.029866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e150eb-ffd8-48bd-a4c2-8544f8fb7151 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:01.084665 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:01.085288 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.085567 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.085843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] PATH_INFO: `/v3/users/677a19ad11304611a8d81eb92526e4d6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.086955 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677a19ad11304611a8d81eb92526e4d6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:01.089627 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:01.135764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677a19ad11304611a8d81eb92526e4d6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.142658 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677a19ad11304611a8d81eb92526e4d6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.143314 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677a19ad11304611a8d81eb92526e4d6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.156923 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677a19ad11304611a8d81eb92526e4d6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.163991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c2b4bd92-bed7-481b-a534-1f583cea5bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677a19ad11304611a8d81eb92526e4d6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.170399 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1398/2806] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:01 2022] DELETE /identity/v3/users/677a19ad11304611a8d81eb92526e4d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:01.459823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:01.461487 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:01.477387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d60c-88d6-4f1c-9f08-839766738861 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:01.487352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:01.537553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:01.538186 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.538465 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.538738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] PATH_INFO: `/v3/projects/f1a2d8430e8648eead39040891ce37d9` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.539896 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a2d8430e8648eead39040891ce37d9)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:01.541879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:01.587693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a2d8430e8648eead39040891ce37d9', 'request_id': 'req-b98179c8-a4db-4dc8-a8e1-776c1d44614f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.594102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a2d8430e8648eead39040891ce37d9', 'request_id': 'req-b98179c8-a4db-4dc8-a8e1-776c1d44614f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.601261 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a2d8430e8648eead39040891ce37d9', 'request_id': 'req-b98179c8-a4db-4dc8-a8e1-776c1d44614f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.613443 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] The token cache is being invalidate because project f1a2d8430e8648eead39040891ce37d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:01.613668 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.614302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b98179c8-a4db-4dc8-a8e1-776c1d44614f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:01.615824 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1409/2807] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:01 2022] DELETE /identity/v3/projects/f1a2d8430e8648eead39040891ce37d9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:01.621118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35fd23-9198-47bc-90b4-45a4671f803a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.621582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35fd23-9198-47bc-90b4-45a4671f803a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.621701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35fd23-9198-47bc-90b4-45a4671f803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.641448 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3c35fd23-9198-47bc-90b4-45a4671f803a None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:01.642651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3c35fd23-9198-47bc-90b4-45a4671f803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:01.701547 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1399/2808] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:28:01.709288 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04342-3d09-4ee0-a1eb-5a7de4e001a2 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.709571 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04342-3d09-4ee0-a1eb-5a7de4e001a2 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.709845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da04342-3d09-4ee0-a1eb-5a7de4e001a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.735711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-2da04342-3d09-4ee0-a1eb-5a7de4e001a2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:01.736964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-2da04342-3d09-4ee0-a1eb-5a7de4e001a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:01.744902 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1410/2809] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:01.749175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35fd23-9198-47bc-90b4-45a4671f803a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:01.767175 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35fd23-9198-47bc-90b4-45a4671f803a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:01.771898 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:01.772520 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.772787 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.773059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.773701 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:28:01.774007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:01.776477 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:01.779028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:01.789890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1400/2810] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:28:01.793694 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04342-3d09-4ee0-a1eb-5a7de4e001a2 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:01.803085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da04342-3d09-4ee0-a1eb-5a7de4e001a2 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:01.807976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:01.808572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.808853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.809127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.809759 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:01.811664 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:01.839793 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1411/2811] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:28:01 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:01.843941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:01.854462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df341d6-0840-4456-9c8c-09353c9975fe admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:01.919584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:01.919584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.919584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.919584 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.920183 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:01.923724 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:01.946510 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1401/2812] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:28:01 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:01.951392 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:01.961617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5709d5-b6cd-4c85-baa7-d6c818df5f8e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:01.966400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:01.966997 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:01.967279 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:01.967556 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:01.968241 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:01.970094 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:01.980127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1412/2813] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:01.983915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:01.994432 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70508a16-bc6e-4b9b-8031-5e8b9fee4595 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:01.999535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a1b23-c4d4-44aa-9ac5-e48ff6aaf832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.000176 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1b23-c4d4-44aa-9ac5-e48ff6aaf832 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.000462 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1b23-c4d4-44aa-9ac5-e48ff6aaf832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.000768 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1b23-c4d4-44aa-9ac5-e48ff6aaf832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.001435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a1b23-c4d4-44aa-9ac5-e48ff6aaf832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.003050 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a1b23-c4d4-44aa-9ac5-e48ff6aaf832 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.014484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1402/2814] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:02.018820 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.028951 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952858-323c-490b-8fea-1266f2ee809a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.033616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.034263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.034546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.034823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] PATH_INFO: `/v3/projects/9f85fcbd00624c62a4d846ba3b26e3bd/users/b9393167d5c640b182ac351648806452/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.049411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f85fcbd00624c62a4d846ba3b26e3bd, user_id=b9393167d5c640b182ac351648806452, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.052081 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.065416 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1413/2815] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:02 2022] PUT /identity/v3/projects/9f85fcbd00624c62a4d846ba3b26e3bd/users/b9393167d5c640b182ac351648806452/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:02.076319 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e15b5-5395-416d-8a02-420049dc27e0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.076607 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e15b5-5395-416d-8a02-420049dc27e0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.076886 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e15b5-5395-416d-8a02-420049dc27e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.106118 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d20e15b5-5395-416d-8a02-420049dc27e0 None None] MFA Rules not processed for user `b9393167d5c640b182ac351648806452`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:02.107324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d20e15b5-5395-416d-8a02-420049dc27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:02.173214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1403/2816] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:02.177656 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.219968 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:02.243377 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d919e1-c391-4118-b0f6-fc29e8b5ab21 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.249491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.250099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.250376 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.250648 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.251275 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.253212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.279474 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1414/2817] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:28:02 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:02.283585 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e15b5-5395-416d-8a02-420049dc27e0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.295151 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e15b5-5395-416d-8a02-420049dc27e0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.350434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.351034 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.351315 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.351589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.352247 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.354644 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.364226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:02.377453 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1404/2818] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:28:02 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:02.381406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.391773 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa4ba-7934-4888-8da1-27675d56abe4 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.396410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.397017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.397301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.397579 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.398224 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.399827 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.410328 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1415/2819] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:02.414322 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.425058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725c5bd-b072-418d-98af-4d25d870fe09 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.429582 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.430258 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.430537 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.430810 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] PATH_INFO: `/v3/projects/a955ed139c8648a294ee3d5d5b161b5b/users/33a2e51024814adbad4f2960f5bf0a32/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.445826 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a955ed139c8648a294ee3d5d5b161b5b, user_id=33a2e51024814adbad4f2960f5bf0a32, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.448535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.461204 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1405/2820] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:02 2022] PUT /identity/v3/projects/a955ed139c8648a294ee3d5d5b161b5b/users/33a2e51024814adbad4f2960f5bf0a32/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:02.465111 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.475301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb1cdd-7fa5-4d10-a793-7326f77e5abd admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.532477 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f49e9-46b9-47c0-81d2-9deeea6e08d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.533160 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f49e9-46b9-47c0-81d2-9deeea6e08d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.533351 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f49e9-46b9-47c0-81d2-9deeea6e08d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.533625 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f49e9-46b9-47c0-81d2-9deeea6e08d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.534266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f49e9-46b9-47c0-81d2-9deeea6e08d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.535892 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f49e9-46b9-47c0-81d2-9deeea6e08d5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.545975 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1416/2821] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:02.550147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.563361 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb9a3-917b-4f6d-a9b2-6fca1e3627f2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.570757 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.573608 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.573905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.574186 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] PATH_INFO: `/v3/projects/a955ed139c8648a294ee3d5d5b161b5b/users/33a2e51024814adbad4f2960f5bf0a32/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.576202 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a955ed139c8648a294ee3d5d5b161b5b, user_id=33a2e51024814adbad4f2960f5bf0a32, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.581199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.591924 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1406/2822] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:02 2022] PUT /identity/v3/projects/a955ed139c8648a294ee3d5d5b161b5b/users/33a2e51024814adbad4f2960f5bf0a32/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:02.657453 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893d07-f3cb-481d-aa32-25bdc997a529 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.657848 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893d07-f3cb-481d-aa32-25bdc997a529 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.658127 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893d07-f3cb-481d-aa32-25bdc997a529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.686079 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-86893d07-f3cb-481d-aa32-25bdc997a529 None None] MFA Rules not processed for user `33a2e51024814adbad4f2960f5bf0a32`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:02.687233 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-86893d07-f3cb-481d-aa32-25bdc997a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:02.756927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1417/2823] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:02.769304 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:02.771028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:02.828790 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa1954-5f84-4d5f-95c9-b96a726a6f46 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:02.832415 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:02.833122 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:02.833400 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:02.833954 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:02.844221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:02.846075 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:02.856239 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1407/2824] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:03.168598 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86893d07-f3cb-481d-aa32-25bdc997a529 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:03.177716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86893d07-f3cb-481d-aa32-25bdc997a529 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:03.182450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a2e51024814adbad4f2960f5bf0a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a955ed139c8648a294ee3d5d5b161b5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:03.183054 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:03.183336 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:03.183628 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:03.184282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:28:03.184590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:03.186181 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:03.198131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1418/2825] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:28:03.202058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:03.211006 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d1bb7-5711-4d20-8750-c5f157535055 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:03.216048 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a2e51024814adbad4f2960f5bf0a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a955ed139c8648a294ee3d5d5b161b5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:03.216633 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:03.216912 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:03.217185 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:03.217824 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:03.220147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:03.245667 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1408/2826] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:28:03 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:03.249729 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:03.260378 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299d5db-1630-4534-b610-1dabff11a41f tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:03.277243 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:03.317311 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a2e51024814adbad4f2960f5bf0a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a955ed139c8648a294ee3d5d5b161b5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:03.317914 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:03.318195 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:03.318467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:03.319102 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:28:03.319404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:03.321031 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:03.333115 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1419/2827] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:28:03.370648 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:03.380825 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731585c3-1c46-4529-8b0e-613270a865fe tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:03.385918 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a2e51024814adbad4f2960f5bf0a32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a955ed139c8648a294ee3d5d5b161b5b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:03.386533 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:03.386811 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:03.387082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] PATH_INFO: `/v3/projects/3b39484c62ae4524a1cbc226632b5eee` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:03.388218 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3b39484c62ae4524a1cbc226632b5eee)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:03.390089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:03.436521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b39484c62ae4524a1cbc226632b5eee', 'request_id': 'req-8474abe5-6dd2-4064-b22d-ee70d043dea4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.441960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b39484c62ae4524a1cbc226632b5eee', 'request_id': 'req-8474abe5-6dd2-4064-b22d-ee70d043dea4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.449775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b39484c62ae4524a1cbc226632b5eee', 'request_id': 'req-8474abe5-6dd2-4064-b22d-ee70d043dea4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.461561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] The token cache is being invalidate because project 3b39484c62ae4524a1cbc226632b5eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:03.461853 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.462535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8474abe5-6dd2-4064-b22d-ee70d043dea4 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.464162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1409/2828] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:03 2022] DELETE /identity/v3/projects/3b39484c62ae4524a1cbc226632b5eee => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:28:03.656142 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:03.657876 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:03.722456 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84c8de-351e-4332-98f3-74b835018390 tempest-VolumeQuotaClassesTest-1385968030 tempest-VolumeQuotaClassesTest-1385968030-project-admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:03.777565 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:03.778200 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:03.778547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:03.778818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] PATH_INFO: `/v3/users/b9393167d5c640b182ac351648806452` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:03.780037 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9393167d5c640b182ac351648806452)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:03.781990 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:03.835603 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9393167d5c640b182ac351648806452'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.836387 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9393167d5c640b182ac351648806452'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.837143 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9393167d5c640b182ac351648806452'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.850040 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:03.851285 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9393167d5c640b182ac351648806452'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.859258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9393167d5c640b182ac351648806452'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:03.872258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1420/2829] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:03 2022] DELETE /identity/v3/users/b9393167d5c640b182ac351648806452 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:03.876855 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:03.877342 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:03.877451 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:03.896156 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:03.897362 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:03.909831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:03.959051 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1410/2830] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:28:03.968977 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:03.970652 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:04.028084 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a135e71-3f4a-4e65-be45-97bb358aa09f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:04.031622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:04.032263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:04.032543 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:04.032818 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:04.042390 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:04.043845 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:04.053257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1421/2831] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:04.315502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:04.317197 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:04.331019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35630f5-143f-4a1e-a8f5-f0519551e67d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:04.335779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:04.336444 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:04.336747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:04.337004 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] PATH_INFO: `/v3/projects/9f85fcbd00624c62a4d846ba3b26e3bd` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:04.338641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f85fcbd00624c62a4d846ba3b26e3bd)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:04.340732 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:04.389525 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f85fcbd00624c62a4d846ba3b26e3bd', 'request_id': 'req-04214ac0-ed19-44e3-b8e2-a14179e2db89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.395300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f85fcbd00624c62a4d846ba3b26e3bd', 'request_id': 'req-04214ac0-ed19-44e3-b8e2-a14179e2db89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.403201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f85fcbd00624c62a4d846ba3b26e3bd', 'request_id': 'req-04214ac0-ed19-44e3-b8e2-a14179e2db89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.414560 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] The token cache is being invalidate because project 9f85fcbd00624c62a4d846ba3b26e3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:04.414834 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.416201 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.417859 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1411/2832] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:04 2022] DELETE /identity/v3/projects/9f85fcbd00624c62a4d846ba3b26e3bd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:04.421909 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:04.431778 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a1d09-6167-4d95-8a9b-7b88780e802f service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:04.487575 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:04.488240 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:04.488524 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:04.488800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] PATH_INFO: `/v3/users/33a2e51024814adbad4f2960f5bf0a32` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:04.489925 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a2e51024814adbad4f2960f5bf0a32)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:04.491879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:04.537622 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a2e51024814adbad4f2960f5bf0a32'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.538282 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a2e51024814adbad4f2960f5bf0a32'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.538898 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a2e51024814adbad4f2960f5bf0a32'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.550904 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a2e51024814adbad4f2960f5bf0a32'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.557760 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6e44ff56-a8c9-4878-ad08-92f98cc2df1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a2e51024814adbad4f2960f5bf0a32'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.569913 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1422/2833] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:04 2022] DELETE /identity/v3/users/33a2e51024814adbad4f2960f5bf0a32 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:04.848545 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:04.849998 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:04.863489 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214ac0-ed19-44e3-b8e2-a14179e2db89 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:04.920559 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:04.921257 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:04.921501 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:04.921779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] PATH_INFO: `/v3/projects/a955ed139c8648a294ee3d5d5b161b5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:04.922964 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a955ed139c8648a294ee3d5d5b161b5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:04.924941 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:04.974753 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:04.978017 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a955ed139c8648a294ee3d5d5b161b5b', 'request_id': 'req-499d1413-72e0-443b-ad8a-a0960c8ce9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.984758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a955ed139c8648a294ee3d5d5b161b5b', 'request_id': 'req-499d1413-72e0-443b-ad8a-a0960c8ce9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:04.991926 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a955ed139c8648a294ee3d5d5b161b5b', 'request_id': 'req-499d1413-72e0-443b-ad8a-a0960c8ce9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:05.003929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] The token cache is being invalidate because project a955ed139c8648a294ee3d5d5b161b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:05.004221 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:05.004858 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-499d1413-72e0-443b-ad8a-a0960c8ce9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:05.006328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1412/2834] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:04 2022] DELETE /identity/v3/projects/a955ed139c8648a294ee3d5d5b161b5b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:05.011980 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5512-8078-4151-8f11-4b54e91ed57f None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.012469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5512-8078-4151-8f11-4b54e91ed57f None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.012590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5512-8078-4151-8f11-4b54e91ed57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.020502 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:05.034602 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-31bf5512-8078-4151-8f11-4b54e91ed57f None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:05.035816 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-31bf5512-8078-4151-8f11-4b54e91ed57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:05.094002 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1423/2835] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:05.101672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ace2f-f314-404f-abd6-806f57deb70b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.101960 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ace2f-f314-404f-abd6-806f57deb70b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.102264 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ace2f-f314-404f-abd6-806f57deb70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.121783 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-707ace2f-f314-404f-abd6-806f57deb70b None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:05.123018 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-707ace2f-f314-404f-abd6-806f57deb70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:05.130681 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1413/2836] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:05.135738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf5512-8078-4151-8f11-4b54e91ed57f None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.145353 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf5512-8078-4151-8f11-4b54e91ed57f None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.149917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.150700 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.150987 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.151267 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.151985 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81704) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:28:05.152375 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.153973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.165345 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1424/2837] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:28:05.170014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ace2f-f314-404f-abd6-806f57deb70b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.178999 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ace2f-f314-404f-abd6-806f57deb70b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.184551 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.185137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.185413 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.185683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.186293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.188193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.215270 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1414/2838] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:05.219522 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.230289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e093c-0619-41fd-aab1-43f6f34a19ce admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.285471 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.286080 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.286363 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.286639 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.287266 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.289227 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.314383 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1425/2839] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:05.318628 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.329233 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd402ca1-b13f-4e5f-939c-61d3ff0b6d2b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.333699 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.334286 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.334562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.334831 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.335488 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.337102 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.347389 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1415/2840] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:05.351176 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.361775 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30168a7d-8307-4a7e-a517-37af0a691de3 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.366411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cded7cd-d8f6-4adc-9c4b-c77f7a8e0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.367110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded7cd-d8f6-4adc-9c4b-c77f7a8e0971 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.367393 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded7cd-d8f6-4adc-9c4b-c77f7a8e0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.367669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded7cd-d8f6-4adc-9c4b-c77f7a8e0971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.368422 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cded7cd-d8f6-4adc-9c4b-c77f7a8e0971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.370671 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cded7cd-d8f6-4adc-9c4b-c77f7a8e0971 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.381096 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1426/2841] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:05.385282 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.395463 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae5d91-7a41-40c4-be8c-1c06d7a5ed0a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.400199 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.400835 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.401112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.401385 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] PATH_INFO: `/v3/projects/513c42b6415b441cb7dca1a10ebbfef7/users/1507b948656444ae8eb162359c052cd8/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.416307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513c42b6415b441cb7dca1a10ebbfef7, user_id=1507b948656444ae8eb162359c052cd8, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.419084 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.432485 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1416/2842] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:05 2022] PUT /identity/v3/projects/513c42b6415b441cb7dca1a10ebbfef7/users/1507b948656444ae8eb162359c052cd8/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:05.442320 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277617b6-0f75-4369-a797-9de85b6f96c7 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.442604 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277617b6-0f75-4369-a797-9de85b6f96c7 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.442907 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277617b6-0f75-4369-a797-9de85b6f96c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.471666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-277617b6-0f75-4369-a797-9de85b6f96c7 None None] MFA Rules not processed for user `1507b948656444ae8eb162359c052cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:05.472923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-277617b6-0f75-4369-a797-9de85b6f96c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:05.531259 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:05.538568 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1427/2843] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:05.542284 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.602956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6273fc-4a23-43cc-9515-f58060e96110 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.608281 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.608881 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.609161 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.609431 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.610057 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.611974 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.638007 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1417/2844] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:28:05.642063 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277617b6-0f75-4369-a797-9de85b6f96c7 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.653090 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277617b6-0f75-4369-a797-9de85b6f96c7 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.707900 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.708508 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.708792 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.709067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.709699 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.711614 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.733856 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1428/2845] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:28:05.737925 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.748272 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291513b-e8b8-4952-bfc9-e95b316b20b7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.752796 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.753386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.753664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.753937 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.754574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.756193 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.766668 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1418/2846] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:05.770662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.781156 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9ffb-0b90-4c70-9c1c-833a9ea1fc66 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.785751 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad45a22-7694-4157-bce0-59780cab241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.786342 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad45a22-7694-4157-bce0-59780cab241a admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.786624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad45a22-7694-4157-bce0-59780cab241a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.786894 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad45a22-7694-4157-bce0-59780cab241a admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.787535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad45a22-7694-4157-bce0-59780cab241a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.789197 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad45a22-7694-4157-bce0-59780cab241a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.799479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1429/2847] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:05.803680 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.813747 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a87e1-a479-48aa-9d6b-b97c35d4efed admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:05.818299 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:05.818939 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.819219 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.819493 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] PATH_INFO: `/v3/projects/23ff7c4fe46948cc9f78e2ea484541dd/users/f71200f5282e4e7a9db10141d78543f6/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.834467 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ff7c4fe46948cc9f78e2ea484541dd, user_id=f71200f5282e4e7a9db10141d78543f6, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:05.837162 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:05.852002 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1419/2848] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:05 2022] PUT /identity/v3/projects/23ff7c4fe46948cc9f78e2ea484541dd/users/f71200f5282e4e7a9db10141d78543f6/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:05.863553 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42208-53ea-489c-a1b5-c91166930b6b None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:05.863869 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42208-53ea-489c-a1b5-c91166930b6b None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:05.864146 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42208-53ea-489c-a1b5-c91166930b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:05.890825 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-fdd42208-53ea-489c-a1b5-c91166930b6b None None] MFA Rules not processed for user `f71200f5282e4e7a9db10141d78543f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:05.892067 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-fdd42208-53ea-489c-a1b5-c91166930b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:05.957134 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1430/2849] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:05.961758 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:05.983625 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:06.026259 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2a917-e59d-4cb2-a37c-09da3665e591 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:06.030903 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:06.031504 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.031785 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.032094 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.032707 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:06.034589 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:06.060058 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1420/2850] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:28:05 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:06.064130 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42208-53ea-489c-a1b5-c91166930b6b None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:06.075418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42208-53ea-489c-a1b5-c91166930b6b None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:06.129771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:06.130307 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.130591 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.130868 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] PATH_INFO: `/v3/users` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.131483 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:06.133444 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:06.144564 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:06.155637 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1431/2851] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:28:06 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:06.159640 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:06.170099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b595bcf-d20a-4b94-a517-58260d208e04 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:06.174721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:06.175316 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.175600 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.175915 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.176561 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:06.178155 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:06.188744 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1421/2852] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:06.192882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:06.203262 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362b628-8b0b-41a9-aac1-8bcc80ba1164 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:06.207823 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:06.208467 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.208742 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.209013 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] PATH_INFO: `/v3/projects/38c615c843b449ff94ed6fe1d086e687/users/e2dbaf49e1224f2bb62f39192f385db2/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.224915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c615c843b449ff94ed6fe1d086e687, user_id=e2dbaf49e1224f2bb62f39192f385db2, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:06.227546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:06.240190 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1432/2853] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:06 2022] PUT /identity/v3/projects/38c615c843b449ff94ed6fe1d086e687/users/e2dbaf49e1224f2bb62f39192f385db2/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:06.244262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:06.254021 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81402786-92ea-40df-b097-6b550e05a08b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:06.310660 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190177c-08ec-40de-8b16-f62c844778a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:06.311268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190177c-08ec-40de-8b16-f62c844778a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.311546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190177c-08ec-40de-8b16-f62c844778a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.311843 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190177c-08ec-40de-8b16-f62c844778a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.312483 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190177c-08ec-40de-8b16-f62c844778a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:06.314054 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190177c-08ec-40de-8b16-f62c844778a3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:06.324113 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1422/2854] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:06.328425 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:06.339466 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1151ca-dde3-4993-806b-53d5bd50fcf5 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:06.344286 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:06.345209 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.345492 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.345771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] PATH_INFO: `/v3/projects/38c615c843b449ff94ed6fe1d086e687/users/e2dbaf49e1224f2bb62f39192f385db2/roles/b73be4c438e74c73b714b299c1412271` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.347712 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c615c843b449ff94ed6fe1d086e687, user_id=e2dbaf49e1224f2bb62f39192f385db2, role_id=b73be4c438e74c73b714b299c1412271)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:06.350426 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:06.360978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1433/2855] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:06 2022] PUT /identity/v3/projects/38c615c843b449ff94ed6fe1d086e687/users/e2dbaf49e1224f2bb62f39192f385db2/roles/b73be4c438e74c73b714b299c1412271 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:06.371535 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.371846 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.372129 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.399820 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] MFA Rules not processed for user `e2dbaf49e1224f2bb62f39192f385db2`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:06.400989 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:06.470643 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1423/2856] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:06.481431 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:06.483258 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:06.546299 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d3673-bc37-4a4c-bfc4-87bb984ec235 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:06.549926 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:06.550526 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:06.550806 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:06.551078 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:06.560743 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:06.562212 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:06.571561 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1434/2857] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:07.065097 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:07.066482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:07.078521 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d901c-2ef3-4ac8-974d-4a318df9ffde None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:07.082013 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:07.082614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:07.082890 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:07.083192 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:07.095795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:07.142956 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:07.144434 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:07.154869 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1424/2858] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:11.204289 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:11.213404 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a824d-cc1c-4023-adf2-02bfa9ab9edc service cinder] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:11.217000 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac573f3-03c1-4c19-ab6c-ad14fbdcf5de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3474a82d27d04dcc9b9818608b00fb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:11.217594 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac573f3-03c1-4c19-ab6c-ad14fbdcf5de service cinder] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:11.217875 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac573f3-03c1-4c19-ab6c-ad14fbdcf5de service cinder] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:11.218150 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac573f3-03c1-4c19-ab6c-ad14fbdcf5de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:11.275741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac573f3-03c1-4c19-ab6c-ad14fbdcf5de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:11.277226 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac573f3-03c1-4c19-ab6c-ad14fbdcf5de service cinder] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:11.286064 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1435/2859] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:13.448641 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:13.511303 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd92ae-2848-4c3c-ac46-eb3d63953c7f service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:13.515876 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:13.516540 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:13.516819 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:13.517095 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] PATH_INFO: `/v3/users/1507b948656444ae8eb162359c052cd8` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:13.518220 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1507b948656444ae8eb162359c052cd8)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:13.520168 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:13.567214 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1507b948656444ae8eb162359c052cd8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:13.575936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1507b948656444ae8eb162359c052cd8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:13.577072 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1507b948656444ae8eb162359c052cd8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:13.591435 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1507b948656444ae8eb162359c052cd8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:13.599346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1507b948656444ae8eb162359c052cd8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:13.607677 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1425/2860] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:13 2022] DELETE /identity/v3/users/1507b948656444ae8eb162359c052cd8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:28:13.612620 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:13.613114 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:13.613218 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:13.634034 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:13.635293 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:13.687008 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:13.696303 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1436/2861] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:13.706226 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:13.707702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:13.750405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:13.777093 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7fc93-e997-4e42-a607-1151a4bfb58d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:13.780795 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:13.781408 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:13.781717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:13.781995 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:13.792779 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:13.794198 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:13.803574 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1426/2862] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:14.076947 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:14.078380 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:14.097017 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1340c-f432-4973-88d0-94f3e9a475b2 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:14.101796 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:14.102436 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:14.102718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:14.103767 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] PATH_INFO: `/v3/projects/513c42b6415b441cb7dca1a10ebbfef7` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:14.104983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513c42b6415b441cb7dca1a10ebbfef7)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:14.106885 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:14.155552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513c42b6415b441cb7dca1a10ebbfef7', 'request_id': 'req-b96f49c9-913e-4b4c-a67b-715bd50e2c47'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.161245 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513c42b6415b441cb7dca1a10ebbfef7', 'request_id': 'req-b96f49c9-913e-4b4c-a67b-715bd50e2c47'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.169131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513c42b6415b441cb7dca1a10ebbfef7', 'request_id': 'req-b96f49c9-913e-4b4c-a67b-715bd50e2c47'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.180684 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] The token cache is being invalidate because project 513c42b6415b441cb7dca1a10ebbfef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:14.180979 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.181933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.183403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1437/2863] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:14 2022] DELETE /identity/v3/projects/513c42b6415b441cb7dca1a10ebbfef7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:28:14.187441 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:14.198063 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf9991-1885-4991-bad8-bbdfe14e7b8b service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:14.256405 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:14.257043 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:14.257323 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:14.257599 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] PATH_INFO: `/v3/users/f71200f5282e4e7a9db10141d78543f6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:14.258719 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71200f5282e4e7a9db10141d78543f6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:14.261194 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:14.307411 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71200f5282e4e7a9db10141d78543f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.315005 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71200f5282e4e7a9db10141d78543f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.315708 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71200f5282e4e7a9db10141d78543f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.328833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71200f5282e4e7a9db10141d78543f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.335770 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71200f5282e4e7a9db10141d78543f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.342324 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1427/2864] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:14 2022] DELETE /identity/v3/users/f71200f5282e4e7a9db10141d78543f6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:14.608448 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:14.609972 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:14.625518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f49c9-913e-4b4c-a67b-715bd50e2c47 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:14.684643 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:14.685284 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:14.685570 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:14.685846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] PATH_INFO: `/v3/projects/23ff7c4fe46948cc9f78e2ea484541dd` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:14.686973 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ff7c4fe46948cc9f78e2ea484541dd)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:14.688928 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:14.734554 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ff7c4fe46948cc9f78e2ea484541dd', 'request_id': 'req-6ae91b45-ad46-41a1-b884-8d38f3de080f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.739899 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ff7c4fe46948cc9f78e2ea484541dd', 'request_id': 'req-6ae91b45-ad46-41a1-b884-8d38f3de080f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.748538 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ff7c4fe46948cc9f78e2ea484541dd', 'request_id': 'req-6ae91b45-ad46-41a1-b884-8d38f3de080f'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.759897 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] The token cache is being invalidate because project 23ff7c4fe46948cc9f78e2ea484541dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:14.760403 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.761068 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.762518 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1438/2865] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:14 2022] DELETE /identity/v3/projects/23ff7c4fe46948cc9f78e2ea484541dd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:14.766632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:14.768147 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:14.780889 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf888f9-b0b0-4bea-969b-05b3dc1654e5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:14.837065 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:14.844945 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:14.845626 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:14.846089 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:14.846581 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] PATH_INFO: `/v3/users/e2dbaf49e1224f2bb62f39192f385db2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:14.848106 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dbaf49e1224f2bb62f39192f385db2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:14.850112 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:14.896805 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dbaf49e1224f2bb62f39192f385db2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.903721 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dbaf49e1224f2bb62f39192f385db2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.904439 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dbaf49e1224f2bb62f39192f385db2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.916562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dbaf49e1224f2bb62f39192f385db2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.923878 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-40eacde3-d064-48ae-ae50-c582ca3b8858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dbaf49e1224f2bb62f39192f385db2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:14.930107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1428/2866] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:14 2022] DELETE /identity/v3/users/e2dbaf49e1224f2bb62f39192f385db2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:15.201800 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.203280 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:15.216454 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91b45-ad46-41a1-b884-8d38f3de080f admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.225964 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:15.274983 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.275609 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.275923 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.276199 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] PATH_INFO: `/v3/projects/38c615c843b449ff94ed6fe1d086e687` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.277406 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c615c843b449ff94ed6fe1d086e687)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.279335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:15.325085 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c615c843b449ff94ed6fe1d086e687', 'request_id': 'req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:15.331016 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c615c843b449ff94ed6fe1d086e687', 'request_id': 'req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:15.338302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c615c843b449ff94ed6fe1d086e687', 'request_id': 'req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:15.350196 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] The token cache is being invalidate because project 38c615c843b449ff94ed6fe1d086e687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:15.350480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:15.351103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-0a9a7c4d-ccf1-43c7-a206-f5a78b18177a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:15.352646 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1439/2867] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:15 2022] DELETE /identity/v3/projects/38c615c843b449ff94ed6fe1d086e687 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:15.358986 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a91cdf-6ccd-451e-bd64-650b97fc3cbd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.359295 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a91cdf-6ccd-451e-bd64-650b97fc3cbd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.359570 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a91cdf-6ccd-451e-bd64-650b97fc3cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.379683 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f8a91cdf-6ccd-451e-bd64-650b97fc3cbd None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:15.380930 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f8a91cdf-6ccd-451e-bd64-650b97fc3cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:15.439709 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1429/2868] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:15.449547 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f2d4-38b5-489c-b364-154f73a3b688 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.449834 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f2d4-38b5-489c-b364-154f73a3b688 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.450110 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f2d4-38b5-489c-b364-154f73a3b688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.470140 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-f0f2f2d4-38b5-489c-b364-154f73a3b688 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:15.471343 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-f0f2f2d4-38b5-489c-b364-154f73a3b688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:15.480028 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1440/2869] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:15.484187 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a91cdf-6ccd-451e-bd64-650b97fc3cbd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.494044 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a91cdf-6ccd-451e-bd64-650b97fc3cbd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.498717 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.499343 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.499622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.499929 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.500575 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:28:15.500880 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.502482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:15.514484 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1430/2870] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Aug 17 16:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:28:15.518616 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f2d4-38b5-489c-b364-154f73a3b688 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.528501 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f2d4-38b5-489c-b364-154f73a3b688 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.533123 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.533718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.533998 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.534298 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] PATH_INFO: `/v3/projects` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.534921 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.536853 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:15.563606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1441/2871] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Aug 17 16:28:15 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:15.567781 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.577759 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be0b09-ccde-4a99-9925-2c64e5b271dc admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.633902 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.634618 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.634905 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.635178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.635789 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.637702 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:15.646354 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:15.659806 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1431/2872] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Aug 17 16:28:15 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:28:15.664049 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.674887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabe86a-907d-4294-a062-8a40841e224e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.679479 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.680105 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.680388 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.680662 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.681452 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.683103 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:15.692863 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1442/2873] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:15.696837 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.706775 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a19c6-e383-4e76-85a3-eacb1e4ae3c3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.711346 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108df3f9-0612-4b8f-a6fa-08842cde3e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.711976 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108df3f9-0612-4b8f-a6fa-08842cde3e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.712866 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108df3f9-0612-4b8f-a6fa-08842cde3e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.713148 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108df3f9-0612-4b8f-a6fa-08842cde3e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.713791 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108df3f9-0612-4b8f-a6fa-08842cde3e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.715356 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108df3f9-0612-4b8f-a6fa-08842cde3e8e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:15.725967 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1432/2874] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Aug 17 16:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:28:15.730647 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.740654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f512f-a1af-4a5d-bb63-81157f65d8f8 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.745520 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.746167 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.746445 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.746718 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] PATH_INFO: `/v3/projects/66219505c3c34785b7ea28a0be8b7b2e/users/bcc46edff1b446439d62591f9d3fca4a/roles/c8ae3e3da796422fab32e4d6a86a89d5` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.761535 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66219505c3c34785b7ea28a0be8b7b2e, user_id=bcc46edff1b446439d62591f9d3fca4a, role_id=c8ae3e3da796422fab32e4d6a86a89d5)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.764201 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:15.777790 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1443/2875] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Aug 17 16:28:15 2022] PUT /identity/v3/projects/66219505c3c34785b7ea28a0be8b7b2e/users/bcc46edff1b446439d62591f9d3fca4a/roles/c8ae3e3da796422fab32e4d6a86a89d5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:28:15.788769 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6badb-2178-42ae-81f9-df67173de575 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.789262 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6badb-2178-42ae-81f9-df67173de575 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.789384 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6badb-2178-42ae-81f9-df67173de575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.817664 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-12e6badb-2178-42ae-81f9-df67173de575 None None] MFA Rules not processed for user `bcc46edff1b446439d62591f9d3fca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:15.818870 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-12e6badb-2178-42ae-81f9-df67173de575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:15.887240 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1433/2876] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:28:15.898418 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:15.900887 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:15.942999 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:15.979295 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055ee49-6849-4117-976d-c641c7c1ba2a admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:15.982950 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035df13c-082a-40f3-b00a-50f21bac5327 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009c623055dc4defa2bd74a82c6a7e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:15.983583 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035df13c-082a-40f3-b00a-50f21bac5327 service glance] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:15.983891 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035df13c-082a-40f3-b00a-50f21bac5327 service glance] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:15.984168 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035df13c-082a-40f3-b00a-50f21bac5327 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:15.992330 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035df13c-082a-40f3-b00a-50f21bac5327 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:15.993969 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035df13c-082a-40f3-b00a-50f21bac5327 service glance] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:16.002612 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1444/2877] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:25.883456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:25.998693 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=17 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:34.689101 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6badb-2178-42ae-81f9-df67173de575 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:34.750963 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6badb-2178-42ae-81f9-df67173de575 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:34.755452 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:34.756107 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:34.756388 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:34.756672 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] PATH_INFO: `/v3/users/bcc46edff1b446439d62591f9d3fca4a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:34.757774 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc46edff1b446439d62591f9d3fca4a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:34.759678 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:34.806610 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc46edff1b446439d62591f9d3fca4a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:34.813814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc46edff1b446439d62591f9d3fca4a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:34.814557 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc46edff1b446439d62591f9d3fca4a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:34.832617 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc46edff1b446439d62591f9d3fca4a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:34.841152 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc46edff1b446439d62591f9d3fca4a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:34.847794 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1434/2878] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:28:34 2022] DELETE /identity/v3/users/bcc46edff1b446439d62591f9d3fca4a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:34.852257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] REQUEST_METHOD: `POST` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:34.852723 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:34.852846 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:34.871666 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.auth.core [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] MFA Rules not processed for user `7d6febb46d1d4d2ea74959cb655ad9f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81704) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:28:34.872916 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:34.930537 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1445/2879] 10.222.0.60 () {58 vars in 958 bytes} [Wed Aug 17 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:28:34.940046 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:34.941476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:34.998936 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379a0a-8a4f-44f5-9e3f-b9545c72e723 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:35.002548 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:35.003181 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:35.003460 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:35.003734 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:35.013566 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:35.014981 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:35.024328 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1435/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:35.290636 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:35.292352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:35.305669 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dba544-088d-4d4c-a541-e12578c01451 None None] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:35.311099 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:35.311771 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:35.312097 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:35.312374 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] PATH_INFO: `/v3/projects/66219505c3c34785b7ea28a0be8b7b2e` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:35.313513 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66219505c3c34785b7ea28a0be8b7b2e)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:35.315606 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:35.362711 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66219505c3c34785b7ea28a0be8b7b2e', 'request_id': 'req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:35.368207 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66219505c3c34785b7ea28a0be8b7b2e', 'request_id': 'req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:35.377036 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66219505c3c34785b7ea28a0be8b7b2e', 'request_id': 'req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:35.388550 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] The token cache is being invalidate because project 66219505c3c34785b7ea28a0be8b7b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81704) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:28:35.388838 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:35.389462 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:28:35.390917 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1446/2881] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:28:35 2022] DELETE /identity/v3/projects/66219505c3c34785b7ea28a0be8b7b2e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:28:43.041546 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:28:43.042982 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:43.070629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:43.116646 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae84781-9fd6-4e83-bc70-214f884383eb service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:28:43.175070 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:28:43.175675 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:28:43.175994 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:28:43.176268 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:28:43.177969 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:28:43.189562 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:28:43.191133 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:28:43.201191 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1436/2882] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:28:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:28:45.385587 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:28:53.196782 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=48 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:48.284335 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:48.285945 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:48.348182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788f9a-05b8-4c06-bc1b-0fbe0a9ad881 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:48.351852 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:48.352463 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:48.352738 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:48.353010 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:48.355630 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:48.365441 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:48.366882 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:48.376316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1447/2883] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:29:48.463138 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:29:48.473091 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224771-4f4f-45b8-b406-85638c6b1c46 service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:29:48.476737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:29:48.477325 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:29:48.477600 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:29:48.477868 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:29:48.480396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:29:48.553712 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:29:48.555143 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:29:48.566279 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1437/2884] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:29:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:29:58.372315 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=26 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:29:58.561430 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=34 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:15.491283 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.493410 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.512915 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ec05f-13a3-4596-adb7-a34398424b6d service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.519361 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '352b7e4d311d491f8e665d4cf7e554b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.520009 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.520316 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.520593 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.522400 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.535641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.537260 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.548480 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1448/2885] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:31:15.656908 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.658635 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.673991 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e342c-9c1a-403f-9ce5-a282456a241f service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.678482 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.679099 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.679380 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.679651 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.681629 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.688978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:15.692814 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.694339 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.703309 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab09f48-31a3-47a6-bf16-6a5c07deed33 service nova] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:15.704082 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1438/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:31:15.707411 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:15.708045 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:15.708450 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:15.708854 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:15.710617 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:15.726281 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:15.727741 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:15.741182 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1449/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:16.925911 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:16.934871 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156de0c5-5128-4275-8f11-0696ecb5fb4e service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:16.938632 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13729a757e1a4f95a957fedb84705960', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:16.939229 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:16.939532 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:16.939833 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:16.941622 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:16.955577 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:16.957019 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:16.968764 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1439/2888] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:23.501360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:23.502812 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:23.527654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f6fab-c479-4517-8ff5-fe121fe263e3 service neutron] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:23.533358 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:23.534058 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:23.534371 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:23.534641 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:23.536525 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:23.550879 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:23.554546 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:23.569469 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1450/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:26.627293 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:26.639333 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115a871-0e31-4821-b7e9-7618d299ddf8 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:26.644337 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:26.645028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:26.645378 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:26.645723 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:26.647502 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:26.660000 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:26.661569 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:26.672691 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1440/2890] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:31:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:31:26.692590 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:26.694965 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:26.788004 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba83c3-82f2-4381-b740-d2f3e1df9f2d service placement] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:26.793352 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:26.793994 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:26.794302 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:26.794572 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] PATH_INFO: `/v3/users/a4405fb9580444eda2c63017ebc41d78` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:26.795716 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4405fb9580444eda2c63017ebc41d78)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:26.797765 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:26.849491 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4405fb9580444eda2c63017ebc41d78'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:26.850152 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4405fb9580444eda2c63017ebc41d78'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:26.850754 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4405fb9580444eda2c63017ebc41d78'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:26.863486 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4405fb9580444eda2c63017ebc41d78'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:26.870360 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4405fb9580444eda2c63017ebc41d78'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:26.883301 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1451/2891] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:26 2022] DELETE /identity/v3/users/a4405fb9580444eda2c63017ebc41d78 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:27.061157 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:27.072014 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0b4e7-e496-4cd5-9ebc-99699ea966b0 service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:27.129984 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:27.130614 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:27.130893 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:27.131165 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] PATH_INFO: `/v3/projects/035e36bbf4bc4c6384765fde5bde5b26` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:27.132300 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035e36bbf4bc4c6384765fde5bde5b26)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:27.134178 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:27.181690 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035e36bbf4bc4c6384765fde5bde5b26', 'request_id': 'req-f2ceccaa-c5f1-499e-af79-487939a553f4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.187307 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035e36bbf4bc4c6384765fde5bde5b26', 'request_id': 'req-f2ceccaa-c5f1-499e-af79-487939a553f4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.193827 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035e36bbf4bc4c6384765fde5bde5b26', 'request_id': 'req-f2ceccaa-c5f1-499e-af79-487939a553f4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.205526 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] The token cache is being invalidate because project 035e36bbf4bc4c6384765fde5bde5b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:27.205818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.206447 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.208011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1441/2892] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:27 2022] DELETE /identity/v3/projects/035e36bbf4bc4c6384765fde5bde5b26 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:27.212257 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:27.213683 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:27.227424 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98ac8a-e64e-47b6-996e-20af6b61b66e admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:27.265446 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:27.285576 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:27.286231 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:27.286515 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:27.286799 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] PATH_INFO: `/v3/users/a338590a3c5b435fadb1d9af83419294` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:27.287976 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a338590a3c5b435fadb1d9af83419294)` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:27.289905 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:27.336927 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a338590a3c5b435fadb1d9af83419294'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.337503 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a338590a3c5b435fadb1d9af83419294'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.338108 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a338590a3c5b435fadb1d9af83419294'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.351014 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a338590a3c5b435fadb1d9af83419294'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.357978 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.notifications [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a338590a3c5b435fadb1d9af83419294'} {{(pid=81704) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.370715 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1452/2893] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Aug 17 16:31:27 2022] DELETE /identity/v3/users/a338590a3c5b435fadb1d9af83419294 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:27.546028 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:31:27.547499 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:31:27.563111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceccaa-c5f1-499e-af79-487939a553f4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:31:27.612739 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:27.624818 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6febb46d1d4d2ea74959cb655ad9f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e2e0137191a4168b0b70f0ebaa36507', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:31:27.625456 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:31:27.625737 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:31:27.626011 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] PATH_INFO: `/v3/projects/471361a1cbe64f62afa1da6cd064dc65` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:31:27.627137 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=471361a1cbe64f62afa1da6cd064dc65)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:31:27.629111 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:31:27.675897 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471361a1cbe64f62afa1da6cd064dc65', 'request_id': 'req-2ab87104-558e-4985-8c41-8fda20d366c4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.681396 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471361a1cbe64f62afa1da6cd064dc65', 'request_id': 'req-2ab87104-558e-4985-8c41-8fda20d366c4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.689059 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471361a1cbe64f62afa1da6cd064dc65', 'request_id': 'req-2ab87104-558e-4985-8c41-8fda20d366c4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.700961 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] The token cache is being invalidate because project 471361a1cbe64f62afa1da6cd064dc65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:31:27.701252 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.701885 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2ab87104-558e-4985-8c41-8fda20d366c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:31:27.703476 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1442/2894] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Aug 17 16:31:27 2022] DELETE /identity/v3/projects/471361a1cbe64f62afa1da6cd064dc65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:31:37.367147 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:31:37.697386 dv-cinder-852208-6-iscsi devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:33:48.556624 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Authenticating user token {{(pid=81704) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:33:48.558030 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:48.696131 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e670-0382-4e5d-871f-1e0649216031 admin admin] Validating token access rules against request {{(pid=81704) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:33:48.754650 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42db1-5943-4dad-9211-463892eeb7e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b4c5c17981649e8a4cffdb84cda0374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '316c09203d964b75a1da935349312a48', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81704) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:33:48.755263 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42db1-5943-4dad-9211-463892eeb7e0 service placement] REQUEST_METHOD: `GET` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:33:48.755552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42db1-5943-4dad-9211-463892eeb7e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:33:48.755847 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42db1-5943-4dad-9211-463892eeb7e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81704) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:33:48.757584 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.fernet_utils [None req-d2f42db1-5943-4dad-9211-463892eeb7e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81704) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:33:48.769346 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42db1-5943-4dad-9211-463892eeb7e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:33:48.770933 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42db1-5943-4dad-9211-463892eeb7e0 service placement] RBAC: Authorization granted {{(pid=81704) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:33:48.781654 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: [pid: 81704|app: 0|req: 1453/2895] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Aug 17 16:33:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:33:58.776552 dv-cinder-852208-6-iscsi devstack@keystone.service[81704]: DEBUG dbcounter [-] [81704] Writing DB stats keystone:SELECT=89 {{(pid=81704) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}